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@) Arrangement of a plurality of Image sensors in a video camera. 



(57) An image pickup device includes a split mem- 
ber (2) for splitting image pickup light from an 
object into a plurality of beams in equal light 
amounts and forming object images at different 
positions. A plurality of image pickup elements 
(101-104) are provided, light-receiving portions 
of which are arranged at split positions which 
are not adjacent to each other when an object 
image is split into a plurality of image portions 
on each image formation plane. An image 
synthesizing circuit (3) receives information 
from the image pickup elements and synth- 
esizes the output object image. The image pick- 
up elements are controlled by a timing signal 
from a single clock generation circuit 
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The present invention relates to an image pickup 
device comprising a plurality of image pickup tubes or 
an image pickup board such as a CCD, MOS element, 
or the like as an image pickup element. 

An image pickup device, which photoelectrically 5 
converts image pickup light from an object using an 
image pickup element such as a CCD, and processes 
the converted electrical signal to display or record an 
object image, is known. As the image pickup element 
used as a photoelectric conversion element, elements w 
having several hundred thousand pixels can be mass- 
produced according to the recent advance of IC tech- 
niques, and are popularly used in home video cam- 
eras. In order to meet a high-quality requirement of 
users, so-called "hi-vision" standard image pickup de- 15 
vices, which can assure higher image quality than the 
existing NTSC standard devices, are changing from 
an examination stage to a practical application stage. 
The hi-vision standard image pickup element requires 
a degree of integration as high as about two million 20 
pixels, and high-grade manufacturing techniques; re- 
sulting in a very expensive element. In addition, the 
signal read frequency is as very high as several ten 
MHz, thus requiring high-grade circuit techniques. 

Under these circumstances, a plurality of image 25 
pickup elements which are used in a conventional 
home video camera, and have several hundred thou- 
sand pixels, are arranged adjacent to each other on 
an image formation plane of an object image so as to 
obtain a high resolution corresponding to several mil- 30 
lion pixels. However, since the image pickup elements 
are normally sealed in packages, they cannot be 
closely arranged adjacent to each other on a single 
plane. Therefore, the above-mentioned expensive 
high-integration image pickup element requiring the 35 
high-grade techniques must be used. 

In a conventional image pickup device, in order to 
increase the resolution, the high-integration image 
pickup element must be used, resulting in an expen- 
sive device, and necessity of difficult circuit techni- 40 
ques. 

The number of pixels of an image pickup element, 
which can be formed in a unit image size, will un- 
doubtedly keep on increasing according to future ad- 
vance of semiconductor manufacturing techniques. 45 
However, when the number of pixels of the image 
pickup element is increased, the area per pixel is de- 
creased almost inversely proportionally to the number 
of pixels. As a result, a light incident amount per pixel 
is decreased in proportion to the area per pixel, and so 
sensitivity is decreased accordingly. 

The same applies to an image pickup tube. That 
is, as the spot size of an electron beam is decreased, 
the resolution can be increased. However, the sensi- 
tivity is decreased for the same reason as described ss 
above. 

In a conventional image pickup device, as descri- 
bed above, when the light incident amount is de- 



creased, the sensitivity is decreased, and image qual- 
ity of a dark portion (low-brightness portion) of an ob- 
ject is especially deteriorated. In addition, in order to 
prevent a decrease in S/N, the standard signal level 
of an image pickup element must be set to be relative- 
ly high. 

SUMMARY OF THE INVENTION 

The present invention has been made in consid- 
eration of the above-mentioned problems, and has as 
its object to provide a low-cost image pickup device, 
which can obtain a high resolution by increasing the 
number of effective pixels without using a high- 
integration image pickup element, and can improve 
image quality with a simple circuit. 

An image pickup device according to an aspect of 
the present invention comprises split means for split- 
ting image pickup light from an object into a plurality 
of beams in equal light amounts, and forming object 
images at different positions, a plurality of image pick- 
up elements, light-receiving portions of which are ar- 
ranged at split positions which are not adjacent to 
each other when an object image is split into a plurality 
of image portions on each image formation plane, and 
an image synthesizing circuit for receiving information 
from the image pickup elements, and synthesizing the 
object image. The image pickup elements are control- 
led by a timing signal from a single clock generation 
circuit. 

In the image pickup device according to the 
above-mentioned aspect, image pickup light from an 
object is split and guided along a plurality of optical 
paths, and a plurality of object images are formed at 
different positions. Each object image is also split into 
a plurality of image portions, and pieces of image in- 
formation output from the image pickup elements ar- 
ranged at the non-neighboring split positions of the 
object image are input to the image synthesizing cir- 
cuit. The image synthesizing circuit synthesizes the 
entire object image. 

It is another object of the present invention to pro- 
vide an image pickup device, which can correct a va- 
riation in sensitivity among image pickup elements 
when a plurality of conventional image pick-up ele- 
ments are used to increase the number of effective 
pixels, and is free from brightness nonunrformity. 

According to another aspect of the present inven- 
tion, an image pickup device comprises split means 
for splitting image pickup light from an object into a 
plurality of beams in equal light amounts, and forming 
object images at different positions, a plurality of im- 
age pickup elements, light-receiving portions of which 
are arranged at split positions which are not adjacent 
to each other when an object image is split into a plur- 
ality of portions on each image formation plane, so 
that each of the light-receiving portions partially over- 
laps the light-receiving portion at least at a neighbor- 
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ing split position of another image formation plane, an 
image synthesizing circuit for receiving information 
from the image pickup elements, and synthesizing the 
object image, and a correction circuit for comparing 
outputs from the overlap portions of the image pickup 5 
elements, and adjusting sensitivity levels of the image 
pickup elements. 

In the image pickup device according to the 
above aspect, image pickup light from an object is 
split and guided along a plurality of optical paths, and 10 
a plurality of object images are formed at different 
positions. Each object image is also split into a plur- 
ality of images, and pieces of image information out- 
put from the image pickup elements arranged at the 
non-neighboring split positions of the object image 15 
are input to the image synthesizing circuit The image 
synthesizing circuit synthesizes the entire object im- 
age. The light-receiving portions at least at neighbor- 
ing positions on different image formation planes par- 
tially overlap each other, and the sensitivity levels of 20 
the image pickup elements are adjusted based on out- 
puts from the overlapping portions. 

It is still another object of the present invention to 
provide an image pickup device which can use even 
a plurality of image pickup elements having large 25 
packages. 

According to still another aspect of the present in- 
vention, an image pickup device comprises split 
means for splitting image pickup light from an object 
into a plurality of beams in equal light amounts, and 30 
forming object images at different positions, a plural- 
ity of image pickup elements each having a plurality 
of light-receiving portions, which are split on a plane, 
the light-receiving portions being arranged at split 
positions which are not adjacent to each other when 35 
an object image is split into a plurality of image posi- 
tions on each image formation plane, and an image 
synthesizing circuit for receiving information from the 
image pickup elements, and synthesizing the object 
image. 40 

In the image pickup device according to the 
above aspect, image pickup light from an object is 
split and guided along a plurality of optical paths, and 
a plurality of object images are formed at different 
positions. Each object image is also split into a plur- 45 
ality of images, and pieces of image information out- 
put from the image pickup elements in which the split 
light-receiving portions are arranged at the non- 
neighboring split positions of the object image are in- 
put to the image synthesizing circuit. The image syn- so 
thesizing circuit synthesizes the entire object image. 

It is still another object of the present invention to 
provide an image pickup device having a high power 
saving effect, which can save power consumption 
when the number of effective pixels is increased to im- 55 
prove image quality. 

According to still another aspect of the present in- 
vention, an image pickup device comprises split 



means for splitting image pickup light from an object 
into a plurality of beams in equal light amounts, and 
forming object images at different positions, a plural- 
ity of image pickup elements, light-receiving portions 
of which are arranged at split positions which are not 
adjacent to each other when an object image is split 
into a plurality of image portions on each image for- 
mation plane, an image synthesizing circuit for receiv- 
ing information from the image pickup elements, and 
synthesizing the object image, and adjusting means 
for setting a photographing condition by utilizing an 
output from one or more of the plurality of image pick- 
up elements. The image pickup elements are control- 
led by a timing signal from a single clock generation 
circuit. 

In the image pickup device according to the 
above aspect, image pickup light from an object is 
split and guided along a plurality of optical paths, and 
a plurality of object images are formed at different 
positions. Each object image is also split into a plur- 
ality of images, and pieces of image information out- 
put from the image pickup elements arranged at the 
non-neighboring split positions of the object image 
are input to the image synthesizing circuit. The image 
synthesizing circuit synthesizes the entire object im- 
age. The adjusting means performs automatic expos- 
ure adjustment, automatic focusing adjustment, auto- 
matic white balance adjustment, and the like on the 
basis of outputs from some image pickup elements. 

It is still another object of the present invention to 
provide an image pickup device which has a good 
space factor of each image pickup element chip when 
a plurality of image pickup elements are used, and 
also has improved an ti- noise characteristics. 

According to still another aspect of the present in- 
vention, an image pickup device comprises split 
means for splitting image pickup light from an object 
into a plurality of beams in equal light amounts, and 
forming object images at different positions, a plural- 
ity of image pickup element chips each having a plur- 
ality of light-receiving portions, which are split on a 
plane, the light-receiving portions being arranged at 
split positions which are not adjacent to each other 
when an object image is split into a plurality of image 
portions on each image formation plane, and an im- 
age synthesizing circuit for receiving information from 
the image pickup element chips, and synthesizing the 
object image. A peripheral circuit portion of each im- 
age pickup element is formed between the split light- 
receiving portions of the image pickup element chip. 
Drivers for driving the image pickup element chips are 
arranged in correspondence with the light-receiving 
portions, and are controlled by a timing signal from a 
single clock generation circuit Each image pickup 
element chip multiplexes information from the light- 
receiving portions, and outputs the multiplexed infor- 
mation. J 

In the image pickup device according to the 
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above aspect, image pickup light from an object is 
split and guided along a plurality of optical paths, and 
a plurality of object images are formed at different 
positions. Each object image is also split into a plur- 
ality of images, and pieces of image information out- 
put from the image pickup element chips in which the 
split light-receiving portions are arranged at the non- 
neighboring split positions of the object image are in- 
put to the image synthesizing circuit. The image syn- 
thesizing circuit synthesizes the entire object image. 
In this case, since the peripheral circuit portion for 
each image pickup element is arranged between a 
plurality of spl it I ight-receiving portions of the element, 
a good space factor can be obtained. In addition, 
since short wiring lines can be used, the influence of 
noise can be eliminated. 

It is still another object of the present invention to 
provide an image pickup device, which allows easy 
bonding of image pickup elements, and can improve 
machinability and reliability. 

According to still another aspect of the present in- 
vention, an image pickup device comprises split 
means for splitting image pickup light from an object 
into a plurality of beams in equal light amounts, and 
forming object images at different positions, a plural- 
ity of image pickup element chips each having a plur- 
ality of light-receiving portions, which are split on a 
plane, the light-receiving portions being arranged at 
split positions which are not adjacent to each other 
when an object image is split into a plurality of image 
portions on each image formation plane, and an im- 
age synthesizing circuit for receiving information from 
the image pickup element chips, and synthesizing the 
object image. A wiring pattern to be connected to a 
connection portion arranged at a side edge of each 
image pickup element chip is formed between the 
split light-receiving portions of the image pickup ele- 
ment chip. 

In the image pickup device according to the 
above aspect, image pickup light from an object is 
split and guided along a plurality of optical paths, and 
a plurality of object images are formed at different 
positions. Each object image is also split into a plur- 
ality of images, and pieces of image information out- 
put from the image pickup element chips in which the 
split light-receiving portions are arranged at the non- 
neighboring split positions of the object image are in- 
put to the image synthesizing circuit. The image syn- 
thesizing circuit synthesizes the entire object image. 
In this case, since the wiring pattern connected to the 
connection portion arranged at the side edge of the 
image pickup element chip is formed between the 
plurality of split light-receiving portions, bonding is 
easy. In addition, since short wiring lines can be used, 
the influence of noise can be eliminated. 

It is still another object of the present invention to 
provide an image pickup device which can obtain 
good image quality for a dark portion of an object as 



well as a bright portion of the image, can set a low 
standard signal level of an image pickup element, and 
can widen a dynamic range of the image pickup ele- 
ment. 

s In order to achieve this object, an image pickup 

device according to still another aspect of the present 
invention comprises an image pickup element for pho- 
toelectrically converting image pickup light from an 
object to output image signals in units of pixels, and 

10 an operation circuit for, when an output level of the im- 
age signal is equal to or lower than a predetermined 
value, determining a signal obtained by adding and 
averaging image signals of neighboring pixels satis- 
fying the same condition as image signals of these 

15 pixels. 

According to still another aspect of the present in- 
vention, an image pickup device comprises a plurality 
of image pickup elements for photoelectrical I y con- 
verting image pickup light from an object to output im- 

20 age signals of corresponding color components in 
units of pixels, and an operation circuit for, when an 
output level of the image signal is equal to or lower 
than a predetermined value, determining a signal ob- 
tained by adding and averaging image signals of 

25 neighboring pixels satisfying the same condition as 
image signals of these pixels. 

In the image pickup device of each of the above 
two aspects, image signals in units of pixels are out- 
put from the image pickup element. When the output 

30 level of each image signal is equal to or lower than a 
predetermined value, image signals of adjacent pix- 
els under the same conditions are added and aver- 
aged. The averaged signal is output as image signals 
of these pixels. Therefore, sufficient image signals 

35 can be obtained for a dark portion of an object. When 
the level of an image signal of each color component 
in units of pixels output from each image pickup ele- 
ment is low, image signals of adjacent pixels under the 
same condition are added and averaged, thus obtain- 

40 ing a sufficient image signal for the color. 

Other objects and features of the present inven- 
tion will become apparent from the following descrip- 
tion of the embodiment taken in conjunction with the 
accompanying drawings. 

45 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a diagram showing principal part accord- 
ing to the first embodiment of the present inven- 

so tion; 

Figs. 2 A and 2B are explanatory views showing 
states of image formation planes of Fig. 1 ; 
Fig. 3 is an explanatory view showing a state ob- 
tained by synthesizing two pieces of image infor- 

55 mation shown in Figs. 2A and 2B; 

Fig. 4 is a diagram showing principal part accord- 
ing to the second embodiment of the present in- 
vention; 
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Figs. 5 A to 5D are explanatory views showing 
states of image formation planes of Fig. 4; 
Fig. 6 is an explanatory view showing a state ob- 
tained by synthesizing four pieces of image infor- 
mation shown in Figs. 5A to 5D; s 
Fig. 7 is a block diagram showing a detailed circuit 
arrangement of an image pickup device having 
the arrangement shown in Fig. 1; 
Figs. 8A and 8B are explanatory views showing 
an example wherein the number of image pickup 10 
elements is increased in the embodiment shown 
in Fig. 1; 

Figs. 9A and 9B are explanatory views showing 
an example wherein the number of image pickup 
elements is increased in the embodiment shown 15 
in Fig. 4; 

Fig. 10 is a diagram showing principal part ac- 
cording to the third embodiment of the present in- 
vention; 

Figs. 11 A and 11 B are explanatory views showing 20 
states of image formation planes of Fig. 10; 
Fig. 12 is an explanatory view showing a state ob- 
tained by synthesizing two pieces of image infor- 
mation shown in Figs. 11 A and 11 B; 
Figs. 13A to 13E are explanatory views showing 25 
states for obtaining a sensitivity correction coef- 
ficient in the embodiment shown in Fig. 10; 
Fig. 14 is a block diagram showing a detailed cir- 
cuit arrangement of an image pickup device hav- 
ing the arrangement shown in Fig. 10; 30 
Figs. 15A and 15B are explanatory views show- 
ing an example wherein the number of splits is in- 
creased in the embodiment shown in Fig. 10; 
Fig. 16 is a diagram showing principal part ac- 
cording to the fourth embodiment of the present 35 
invention; 

Fig. 17 is an explanatory view showing states of 
image formation planes of Fig. 16; 
Figs. 18A to 18D are explanatory views showing 
states for obtaining a sensitivity correction coef- 40 
ficient in the embodiment shown in Fig. 16; 
Figs. 19A and 19B are explanatory views show- 
ing an example wherein the number of image 
pickup elements is increased in the embodiment 
shown in Fig. 16; 45 
Fig. 20 is a diagram showing principal part ac- 
cording to the fifth embodiment of the present in- 
vention; 

Figs. 21 A and 21 B are explanatory views show- 
ing states of image formation planes of Fig. 20; so 
Fig. 22 is an explanatory view showing a state ob- 
tained by synthesizing two pieces of image infor- 
mation shown in Figs. 21 A and 21 B; 
Figs. 23A and 23B are explanatory views show- 
ing setting examples of light-receiving portions 55 
on the respective image formation planes of Fig. 
20; 

Fig. 24 is a diagram showing principal part ac- 



cording to the sixth embodiment of the present in- 
vention; 

Figs. 25A to 25D are explanatory views showing 
states of image formation planes of Fig. 24; 
Fig . 26 is an explanatory view showing a state ob- 
tained by synthesizing four pieces of image infor- 
mation shown in Figs. 25A to 25D; 
Figs. 27A to 27D are explanatory views showing 
setting examples of light-receiving portions on 
the respective image formation planes shown in 
Fig. 24; 

Fig. 28 is a block diagram showing a detailed cir- 
cuit arrangement of an image pickup device hav- 
ing the arrangement shown in Fig. 20; 
Fig. 29 is an explanatory view showing a basic 
unit when the number of image pickup elements 
is increased in the embodiment shown in Fig. 20; 
Figs. 30A and 30B are explanatory views show- 
ing an example wherein the number of image 
pickup elements is increased in the embodiment 
shown in Fig. 20; 

Fig . 31 is an explanatory view showing a state ob- 
tained by synthesizing two pieces of image infor- 
mation shown in Figs. 30A and 30B; 
Figs. 32A and 32 B are explanatory views show- 
ing setting examples of light-receiving portions of 
image pickup elements in the arrangement 
shown in Figs. 30A and 30 B; 
Fig. 33 is an explanatory view showing a basic 
unit when the number of image pickup elements 
is increased in the embodiment shown in Fig. 24; 
Figs. 34A to 34D are explanatory views showing 
an example wherein the number of image pickup 
elements is increased in the embodiment shown 
in Fig. 24; 

Fig. 35 is an explanatory view showing a state ob- 
tained by synthesizing four pieces of image infor- 
mation shown in Figs. 34A to 34D; 
Figs. 36A to 36D are explanatory views showing 
setting examples of light-receiving portions of the 
image pickup elements shown in Figs. 34A to 
34D; 

Fig. 37 is a diagram showing principal part ac- 
cording to the seventh embodiment of the present 
invention; 

Figs. 38A and 38B are explanatory views show- 
ing states of image formation planes of Fig. 37; 
Fig. 39 is an explanatory view showing a state ob- 
tained by synthesizing two pieces of image infor- 
mation shown in Figs. 38A and 38B; 
Fig. 40 is a block diagram showing an arrange- 
ment of an image pickup unit having an image 
pickup element shown in Fig. 37; 
Fig. 41 is a block diagram showing a circuit ar- 
rangement of an image pickup device of the ar- 
rangement shown in Fig. 37; 
Fig. 42 is a flowchart showing an operation of the 
circuit shown in Fig. 41; 
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Fig. 43 is a block diagram showing an arrange- 
ment of an image pickup unit x1 when white bal- 
ance adjustment is performed by the circuit 
shown in Fig. 41; 

Fig. 44 is a block diagram showing an arrange- s 
ment of image pickup units x2 to x4 when white 
balance adjustment is performed by the circuit 
shown in Fig. 41 ; 

Fig. 45 is a diagram showing principal part ac- 
cording to the eighth embodiment of the present w 
invention; 

Figs. 46A to 46D are explanatory views showing 
states of image formation planes of Fig. 45; 
Fig. 47 is an explanatory view showing a state ob- 
tained by synthesizing two pieces of image infor- is 
mation shown in Figs. 46Aand 46B; 
Fig. 48 is a block diagram showing a circuit ar- 
rangement of an image pickup device having the 
arrangement shown in Fig. 45; 

Figs. 49A and 49B are explanatory views show- 20 
ing an example wherein the number of image 
pickup elements is increased in the embodiment 
shown in Fig. 37; 

Figs. 50A and 50B are explanatory views show- 
ing an example wherein the number of image 25 
pickup elements is increased in the embodiment 
shown in Fig. 45; 

Fig. 51 is a diagram showing principal part ac- 
cording to the ninth embodiment of the present in- 
vention; 30 
Figs. 52A to 52 D are explanatory views showing 
states of image formation planes of Fig. 51 ; 
Fig. 53 is an explanatory view showing a state ob- 
tained by synthesizing four pieces of image infor- 
mation shown in Figs. 52A to 52D; 35 
Figs. 54Ato 54D are explanatory views showing 
setting examples of light-receiving portions of an 
image pickup element chip shown in Figs. 52Ato 
52D; 

Fig. 55 is a plan view showing a detailed structure 40 
of a normal image pickup element chip; 
Fig. 56 is a plan view showing a detailed structure 
of an image pickup element chip shown in Figs. 
54A to 54D; 

Fig. 57 is a diagram showing an example wherein 45 
an input/output circuit is arranged between light- 
receiving portions of the semiconductor chip 
shown in Fig. 56; 

Fig. 58 is a diagram showing an example wherein 

the input side in the semiconductor chip shown in 50 

Fig. 57 is multiplexed; 

Fig. 59 is a diagram showing an example wherein 
the output side in the semiconductor chip shown 
in Fig. 57 is multiplexed; 

Fig. 60 is a diagram showing an example wherein 55 
a multiplexer is arranged at the output side of an 
output circuit in the semiconductor chip shown in 
Fig. 59; 



Fig. 61 is a block diagram showing a circuit ar- 
rangement of an image pickup device having the 
arrangement shown in Fig. 51; 
Fig. 62 is an explanatory view showing a basic 
unit when the number of effective pixels is in- 
creased; 

Figs. 63A to 63D are explanatory views showing 
an example wherein the number of image pickup 
element chips is increased; 
Fig. 64 is an explanatory view showing a state ob- 
tained by synthesizing four pieces of image infor- 
mation shown in Figs. 63A to 63D; 
Figs. 65A to 65D are explanatory views showing 
setting examples of light-receiving portions of the 
image pickup element chips shown in Figs. 63A 
to 63D; 

Fig. 66 is a diagram showing principal part ac- 
cording to the tenth embodiment of the present in- 
vention; 

Figs. 67A to 67D are explanatory views showing 
states of image formation planes of Fig. 66; 
Fig. 68 is an explanatory view showing a state ob- 
tained by synthesizing four pieces of image infor- 
mation shown in Figs. 67A to 67D; 
Figs. 69A to 69D are explanatory views showing 
setting examples of light-receiving portions of an 
image pickup element chip shown in Figs. 67 A to 
67D; 

Fig. 70 is a diagram showing a detailed arrange- 
ment of the image pickup element chip shown in 
Figs. 69A to 69D; 

Fig. 71 is a diagram showing an arrangement 
wherein light-receiving portions of the semicon- 
ductor chip shown in Fig. 70 are connected 
through wiring lines; 

Fig. 72 is a block diagram showing a circuit ar- 
rangement of an image pickup device having the 
arrangement shown in Fig. 66; 
Fig. 73 is an explanatory view showing a basic 
unit when the number of effective pixels is in- 
creased; 

Fig. 74 A to 74 D are explanatory views showing 
an example wherein the number of effective pix- 
els is increased; 

Fig. 75 is an explanatory view showing a state ob- 
tained by synthesizing image information shown 
in Fig. 74; 

Figs. 76A to 76D are explanatory views showing 
setting examples of light-receiving portions of the 
image pickup element chip shown in Fig. 74; 
Figs. 77A to 77C are explanatory views of image 
formation planes of an optical system; 
Figs. 78A and 78B are explanatory views of im- 
age formation planes of an optical system ac- 
cording to the eleventh embodiment of the pres- 
ent invention; 

Fig. 79 is a diagram showing an arrangement of 
an optical system according to the twelfth en> 
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bodiment of the present invention; 
Figs. 80A to 80E are explanatory views of image 
formation planes of an optical system according 
to the thirteenth embodiment of the present in- 
vention; 

Fig. 81 is a diagram showing an electrical circuit 
of the eleventh embodiment of the present inven- 
tion; 

Fig. 82 is an explanatory view of a basic unit of 
an optical system as an extended example of the 
eleventh embodiment; 

Figs. 83A to 83C are explanatory views of image 
formation planes of the optical system of the ex- 
tended example shown in Fig. 82; 
Fig. 84 is an explanatory view of a basic unit of 
an optical system as an extended example of the 
twelfth embodiment; 

Figs. 85A to 85E are explanatory views of image 
formation planes of the optical system of the ex- 
tended example shown in Fig. 84; 
Fig. 86 is a btock diagram showing a circuit ar- 
rangement according to the thirteenth embodi- 
ment of the present invention; 
Fig. 87 is a flow chart showing an operation of the 
circuit shown in Fig. 86; and 
Fig. 88 is a block diagram showing a circuit ar- 
rangement according to the fourteenth embodi- 
ment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Fig. 1 is a diagram showing a principal part of an 
image pickup device according to the first embodi- 
ment of the present invention. The image pickup de- 
vice shown in Fig. 1 includes an imaging lens 1 
through which image pickup light L from an object 
passes, and a beam splitter 2 as split means for split- 
ting the image pickup light L into a plurality of beams 
L1 and L2 in equal light amounts, and forming object 
images at different positions. The beam splitter 2 
comprises, e.g., a half mirror. The image pickup de- 
vice also includes a plurality of image pickup elements 
(e.g., CCDs) 101 to 104 whose light-receiving por- 
tions are arranged on image formation planes A and 
B of the split object images. The light-receiving por- 
tions are arranged at non- neigh boring split positions 
when an object image is split into a plurality of images 
(in this case, four images) on each of the image for- 
mation planes A and B. More specifically, since the im- 
age pickup elements 101 to 104 are sealed in pack- 
ages, an object image is split into a plurality of images 
on each of the image formation planes A and B, and 
the image pickup elements 101 to 104 are arranged 
at non-neighboring positions so as not to interfere 
with each other. The image pickup device also in- 
cludes an image synthesizing circuit 3 for receiving 
image information from the image pickup elements 



101 to 104 to synthesize the entire object image. 

In the image pickup device having the above- 
mentioned arrangement, the image pickup light L re- 
ceived from an object through the lens 1 is guided as 

5 the beams L1 and L2 having equal light amounts 
along two optical paths split by the beam splitter 2, 
and the beams L1 and L2 reach the corresponding im- 
age formation planes (focal planes) A and B. Thus, 
object images having the same size and the same 

10 brightness are formed on the image formation planes 
A and B. Figs. 2Aand 2B show states of the image for- 
mation planes Aand B. Fig. 2A shows the state of the 
image formation plane A, and Fig. 2B shows the state 
of the image formation plane B. 

15 On each of the image formation planes A and B, 

an object image is split into four images. On the image 
formation plane A, light-receiving portions a1 and a2 
of the image pickup elements 101 and 103 are respec- 
tively located at the first and third split positions which 

20 are not adjacent to each other. On the image forma- 
tion plane B, light-receiving portions b1 and b2 of the 
image pickup elements 102 and 104 are respectively 
located at the second and fourth split positions which 
are not adjacent to each other. Four pieces of image 

25 information photoelectrical I y converted by the image 
pickup elements 101 to 104 are input to the image 
synthesizing circuit 3, and are synthesized, as shown 
in Fig. 3, thereby forming a complete object image as 
a whole. 

30 The total number of effective pixels on the image 

formation planes A and B can be four times that of a 
single image pickup element, and a resolution equiv- 
alent to that obtained when an image pickup element 
having the number of pixels four times that of a con- 

35 ventional image pickup element, can be obtained, 
thus obtaining an image having improved image qual- 
ity. Since conventional image pickup elements used in 
a home video camera can be used without using a 
high- integration image pickup element, a low-cost im- 

40 age pickup device can be constituted by a simple cir- 
cuit. 

Fig. 4 is a diagram showing the second embodi- 
ment of the present invention. The same reference 
numerals in Fig. 4 denote the same parts as in Fig. 1. 

45 Fig. 4 illustrates only an image pickup optical system. 

In the embodiment shown in Fig. 4, the number of 
split optical paths of image pickup light L is doubled, 
i.e., four as compared to the embodiment shown in 
Fig. 1, and three beam splitters 2a, 2b, and 2c are ar- 

50 ranged. These beam splitters 2a, 2b, and 2c respec- 
tively have reflectances of 25% (1/4), 33% (1/3), and 
50% (1/2), and supply beams L1, L2, L3, and L4 hav- 
ing equal light amounts to four image formation 
planes A, B, C, and D, thus forming object images 

55 having the same size and the same brightness on the 
image formation planes A, B, C, and D. The object im- 
age on each of the image formation planes A, B, C. 
and D is split into a plurality of images, and light- 
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receiving portions of image pickup elements (not 
shown) are arranged at non- neighboring split posi- 
tions of the images. Pieces of image information from 
these image pickup elements are synthesized to form 
the entire object image. 

In the embodiment shown in Fig. 4, an object im- 
age is split into 16 images (4 x 4 in the horizontal and 
vertical directions) on each of the image formation 
planes A, B, C, and D, as shown in Figs. 5Ato 5D. The 
light-receiving portions of the image pickup elements 
are arranged at non-neighboring four split positions 
on each image formation plane. More specifically, on 
the image formation plane A shown in Fig. 5A, light- 
receiving portions a1 , a2, a3, and a4 are respectively 
arranged at the first, third, ninth, and eleventh posi- 
tions. On the image formation plane B shown in Fig. 
5B, light-receiving portions b1, b2, b3 f and b4 are re- 
spectively arranged at the second, fourth, tenth, and 
twelfth positions. On the image formation plane C 
shown in Fig. 5C, light-receiving portions d, c2, c3 f 
and c4 are respectively arranged at the fifth, seventh, 
thirteenth, and fifteenth positions. On the image for- 
mation plane D shown in Fig. 5D, light-receiving por- 
tions d1 , d2, d3, and d4 are respectively arranged at 
the sixth, eighth, fourteenth, and sixteenth positions. 

Image information of an object, which is sepa- 
rately picked up by the 16 light-receiving portions a1 
to a4, b1 to b4, c1 to c4, and d1 to d4 in the above- 
mentioned arrangement states of the image pickup 
elements on the image formation planes A, B, C, and 
D, is synthesized by the image synthesizing circuit, as 
described above. Fig. 6 shows the state of the synthe- 
sized image information, and illustrates contributions 
of the respective light-receiving portions to the object 
image. In this embodiment, the number of effective 
pixels on the image formation planes A, B, C, and D 
is 16 times that of a single image pickup element, and 
a resolution equivalent to that obtained when an im- 
age pickup element having the number of pixels 16 
times that of a conventional image pickup element, 
can be obtained, thus obtaining an image with higher 
image quality than that of the embodiment shown in 
Fig. 1. 

Fig. 7 is a block diagram showing a detailed circuit 
arrangement of the image pickup device having the 
arrangement shown in Fig. 1 . The image pickup de- 
vice shown in Fig. 7 includes an image pickup unitXI . 
The image pickup unit X1 comprises the image pickup 
element (e.g., a CCD) 1 01 shown in Fig. 1 , a driver 111 
for driving the image pickup element 101, an S/H cir- 
cuit 121 for sampling and holding an output from the 
image pickup element 101, an A/D converter 131 for 
converting sampled/held analog image information 
into a digital signal, and an image memory 141 for 
storing the digital image information. The image pick- 
up device also includes image pickup units X2, X3, 
and X4 having the same arrangement as that of the 
image pickup unit X1. More specifically, the image 



pickup units X2, X3, and X4 respectively comprise the 
image pickup elements 102, 103, and 104 shown in 
Fig. 1, drivers 112, 113, and 114, S/H circuits 122, 

123, and 124, A/D converters 132, 133, and 134, and 
5 image memories 142, 143, and 144 like in the image 

pickup unit X1 . The image pickup device also includes 
a single clock generation circuit 4. The operation tim- 
ings of the drivers 111 to 114, the S/H circuits 121 to 

124, the A/D converters 131 to 134, and the image 
10 memories 141 to 144 of the image pickup units X1 to 

X4 are controlled by a timing signal output from the 
clock generation circuit 4. In addition, the driving op- 
erations of the image pickup elements 101 to 104 are 
also controlled by this timing signal. The operation of 

15 the image synthesizing circuit 3 is also controlled by 
the timing signal from the clock generation circuit 4. 
An image signal from an output terminal 5 is output to 
a display or a recorder (not shown). 

The image pickup elements 101 to 104 of the im- 

20 age pickup units X1 to X4 respectively have the light- 
receiving portions a1, b1, a2, and b2 shown in Figs. 
2 A and 2B, and Fig. 3, and pieces of image informa- 
tion of the four split object images described above 
are respectively stored in the image memories 141 to 

25 1 44. The pieces of image information stored in the im- 
age memories 141 to 144 are read out in response to 
the signal from the clock generation circuit 4, and are 
input to the image synthesizing circuit 3. The image 
synthesizing circuit 3 synthesizes the image informa- 

30 tion of the overall object, and an image signal ob- 
tained by picking up an object is output from the out- 
put terminal 5. 

The circuit arrangement of the image pickup de- 
vice having the arrangement shown in Fig. 4 can be 

35 realized by arranging 16 image pickup units shown in 
Fig. 7. Pieces of image information from the image 
pickup units need only be input to the image synthe- 
sizing circuit to form the overall object image. 

The above-mentioned image memories 141 to 

40 1 44 and the image synthesizing circuit 3 can be easily 
realized by using known memories and their control 
techniques, which are normally used. Therefore, a de- 
tailed description of these memories and image syn- 
thesizing circuit will be omitted. In addition, more 

45 beam splitters than those in the above embodiment 
may be used to increase the number of split object im- 
ages on each image formation plane, thereby obtain- 
ing an image having a higher resolution. 

In the embodiment shown in Fig. 1, when the 

50 light-receiving portions a1 and b1 are juxtaposed in a 
unit shown in Fig. 8A, the number of image pickup ele- 
ments can be infinitely increased. Fig. 8B shows a 
case wherein light-receiving portions a and b are con- 
stituted by eight portions. 

55 In the embodiment shown in Fig. 4, when light- 

receiving portions a1, b1, d, and d1 are arranged in 
the vertical and horizontal directions in a unit shown 
in Fig. 9A, the number of image pickup elements can 
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be infinitely increased. Fig. 9B shows a case wherein 
light-receiving portions a, b, c, and d are constituted 
by 64 portions. 

In this manner, when an image formation optical 
path used in, e.g., an existing industrial-use multi-bo- 5 
ard camera is split into a plurality of paths by a beam 
splitter, the equivalent number of pixels can be greatly 
increased, and an image having higher image quality 
can be obtained. For example, when an image pickup 
element having four hundred thousand pixels and 10 
used in an existing home video camera is adopted in 
the present invention, the number of pixels can reach 
1.6 millions in the embodiment shown in Fig. 1, and 
can reach 6.4 millions in the embodiment shown in 
Fig. 4. When the image size is further increased, the 15 
number of effective pixels can be infinitely increased. 

As described above, according to the above- 
mentioned embodiments, image pickup light from an 
object is split into a plurality of beams in equal light 
amounts, and object images are formed at different 20 
positions. The light-receiving portions of the image 
pickup elements are arranged at non- neigh boring 
split positions when the object image is split into a 
plurality of images on each image formation plane, 
and pieces of image information are synthesized lat- 25 
er Thus, the number of effective pixels can be in- 
creased using conventional image pickup elements 
without using a high-integration image pickup ele- 
ment, and image quality can be improved at low cost 
by a simple arrangement. 30 

Fig. 10 is a diagram showing principal part of an 
image pickup device according to the third embodi- 
ment of the present invention. The image pickup de- 
vice shown in Fig. 10 includes an imaging lens 1 
through which image pickup light L from an object 35 
passes, and a beam splitter 2 as split means for split- 
ting the image pickup light L into a plurality of beams 
L1 and L2 in equal light amounts, and forming object 
images at different positions. The beam splitter 2 
comprises, e.g., a half mirror. The image pickup de- 40 
vice also includes a plurality of image pickup elements 
(e.g., CCDs) 101 to 104 whose light-receiving por- 
tions are arranged on image formation planes A and 
B of the split object images. The light-receiving por- 
tions are arranged at non- neigh boring split positions 45 
when an object image is split into a plurality of images 
(in this case, four images) on each of the image for- 
mation planes Aand B. More specifically, since the im- 
age pickup elements 101 to 104 are sealed in pack- 
ages, an object image is split into a plurality of images so 
on each of the image formation planes A and B, and 
the image pickup elements 101 to 104 are arranged 
at non-neighboring positions so as not to interfere 
with each other. Each of the light-receiving portions of 
the image pickup elements 101 to 104 is arranged to ss 
partially overlap the neighboring split position of an- 
other image formation plane. The image pickup de- 
vice also includes an image synthesizing circuit 3 for 
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receiving image information from the image pickup 
elements 101 to 104 to synthesize the entire object 
image, and a correction circuit 4 for comparing out- 
puts from the overlap portions of the image pickup 
elements 101 to 104 to adjust their sensitivity levels. 

In the image pickup device having the above- 
mentioned arrangement, the image pickup light L re- 
ceived from an object through the lens 1 is guided as 
the beams L1 and L2 having equal light amounts 
along two optical paths split by the beam splitter 2, 
and the beams L1 and L2 reach the corresponding im- 
age formation planes (focal planes) A and B. Thus, 
object images having the same size and the same 
brightness are formed on the image formation planes 
Aand B. Figs. 11 A and 11 B show states of the image 
formation planes Aand B. Fig. 11 A shows the state of 
the image formation plane A, and Fig. 11 B shows the 
state of the image formation plane B. 

On each of the image formation planes A and B, 
an object image is split into four images. On the image 
formation plane A, light-receiving portions a1 and a2 
of the image pickup elements 101 and 103 are respec- 
tively located at the first and third split positions which 
are not adjacent to each other. On the image forma- 
tion plane B, light-receiving portions b1 and b2 of the 
image pickup elements 102 and 104 are respectively 
located at the second and fourth split positions which 
are not adjacent to each other. Four pieces of image 
information photoelectrically converted by the image 
pickup elements 101 to 104 are input to the image 
synthesizing circuit 3, and are synthesized, as shown 
in Fig. 12, thereby forming a complete object image 
as a whole. 

The total number of effective pixels on the image 
formation planes A and B can be four times that of a 
single image pickup element, and a resolution equiv- 
alent to that obtained when an image pickup element 
having the number of pixels four times that of a con- 
ventional image pickup element, can be obtained, 
thus obtaining an image having improved image qual- 
ity. Since conventional image pickup elements used in 
a home video camera can be used without using a 
high-integration image pickup element, a low-cost im- 
age pickup device can be constituted by a simple cir- 
cuit. 

When the image pickup elements 101 to 104 suf- 
fer from variations in sensitivity, brightness nonuni- 
formity is formed in a finally synthesized image. In 
this embodiment, in order to correct this variation, the 
above-mentioned overlap portions are provided to 
the light-receiving portions of the image pickup ele- 
ments 101 to 104, and the outputs from the overlap 
portions are compared with each other to adjust the 
sensitivity levels of the image pickup elements 101 to 
1 04. The sensitivity correction will be described in de- 
tail below. For the sake of simplicity, a case will be ex- 
emplified below wherein the number of split image 
planes in the optical system shown in Fig. 10 is two. 
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More specifically, as shown in Fig. 13A, an image 
plane is split into two portions, i.e., a portion X1 sur- 
rounded by a solid line, and a portion X2 surrounded 
by a broken line, and these portions have an overlap 
portion therebetween. On one image formation plane s 
A, a light-receiving portion a of an image pickup ele- 
ment is arranged to cover a hatched portion corre- 
sponding to the portion X1, as shown in Fig. 13B. On 
the other image formation plane B, a light-receiving 
portion b of another image pickup element is ar- 10 
ranged to cover a hatched portion corresponding to 
the portion X2, as shown in Fig. 1 3C. Thus, a hatched 
portion shown in Fig. 13D is partially included as im- 
age pickup regions of the image pickup elements hav- 
ing the light-receiving portions a and b. Therefore, 15 
one of the two image pickup elements is determined 
as a reference element, and the gain of the output 
from the other image pickup element is controlled, so 
that the two outputs from the overlap portion on the 
image plane are equal to each other. As a result, a va- 20 
nation in sensitivity between the two image pickup 
elements can be corrected, and brightness nonuni- 
formity can be eliminated. When a final output is ob- 
tained, image information corresponding to the entire 
surface of the light- receiving portion a of one image 25 
pickup element, and image information correspond- 
ing to only a portion, which does not overlap the light- 
receiving portion a, of the light-receiving portion b of 
the other image pickup element are used to synthe- 
size a complete object image, as shown in Fig. 13E. 30 

Fig. 14 is a block diagram showing a detailed cir- 
cuit arrangement of the image pickup device having 
the arrangement shown in Fig. 1 0. In this case, a case 
will be exemplified wherein an image plane is split into 
two portions like in Figs. 13A to 1 3E. The image pick- 35 
up device shown in Fig. 14 includes an image pickup 
unit X1 . The image pickup unit X1 comprises the im- 
age pickup element (e.g., a CCD) 101 shown in Fig. 
10, a driver 111 for driving the image pickup element 
101, an S/H circuit 121 for sampling and holding an 40 
output from the image pickup element 101, an A/D 
converter 131 for converting sampled/held analog im- 
age information into a digital signal, and an image 
memory 141 for storing the digital image information. 
The image pickup device also includes an image pick- 45 
up unit X2 having the same arrangement as that of the 
image pickup unit X1. More specifically, the image 
pickup unit X2 comprises the image pickup element 
102 shown in Fig. 10, a driver 112, an S/H circuit 122, 
an A/D converter 1 32, and an image memory 1 42 like so 
in the image pickup unit X1. The image pickup device 
also includes a single clock generation circuit 5. The 
operation timings of the drivers 111 and 112, the S/H 
circuits 121 and 122, the A/D converters 131 and 132, 
and the image memories 141 and 142 are controlled 55 
by a timing signal output from the dock generation cir- 
cuit 5. The driving operations of the image pickup ele- 
ments 101 and 102 are also controlled by this timing 



signal. The operation of the image synthesizing circuit 
3 is also controlled by the timing signal from the clock 
generation circuit 5, and an image signal is output 
from an output terminal 6 to a display or a recorder 
(not shown). 

The image pickup device in Fig. 14 also includes 
overlap portion reading-out circuits 7a and 7b for 
reading out the outputs from the overlap portions of 
the image pickup elements, a comparison circuit 8 for 
comparing these outputs, and a coefficient circuit 9 
for multiplying the output from the image pickup unit 
X2 with a coefficient according to the comparison re- 
sult, and inputting the product to the image synthesiz- 
ing circuit 3. The above-mentioned circuits constitute 
the correction circuit 4 shown in Fig. 10. 

The image pickup elements 101 and 102 of the 
image pickup units X1 and X2 respectively have the 
light-receiving portions a and b shown in Figs. 13B 
and 13C, and two pieces of image information corre- 
sponding to two split object images are stored in the 
image memories 141 and 142, as described above. 
The image information stored in each of the image 
memories 141 and 142 is read out in response to the 
signal from the clock generation circuit 5, and is input 
to the image synthesizing circuit 3. The image synthe- 
sizing circuit 3 synthesizes the image information of 
the entire object, and an image signal obtained by 
photographing an object is output from the output ter- 
minal 6, as described above. In this case, information 
of the hatched overlap portion in Fig. 13D of the im- 
age information stored in each of the image memories 
141 and 142 is read out by a corresponding one of the 
overlap portion reading-out circuits 7a and 7b, and 
two pieces of readout information are compared by 
the comparison circuit 8. A variation in sensitivity of 
the two image pickup elements 101 and 102 is cor- 
rected according to the comparison result. 

More specifically, the comparison circuit 8 uses 
an average luminance Y1 of the output from the over- 
lap portion of the image pickup element 101 as a ref- 
erence value, and calculates a ratio of the reference 
value to an average luminance Y2 of the output from 
the overlap portion of the image pickup element 102. 
In other words, the comparison circuit 8 calculates K 
= Y1/Y2. The comparison circuit 8 then supplies the 
coefficient K to the coefficient circuit 9. 

The image synthesizing circuit 3 outputs synthe- 
sized image information (Fig. 13E) from the output 
terminal 6 by utilizing all the information in the image 
memory 141, and information obtained by multiplying 
information in the image memory 142 excluding infor- 
mation of the overlap portion with the coefficient K. 

In the above description, the case has been ex- 
emplified wherein the image plane is split into two 
portions. Upon repeating this operation, the number 
of split image plane portions can be increased. For 
example, when an image plane is split into four por- 
tions, as shown in Fig. 1 5A, light-receiving portions al, 
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b1, a2, and b2 are arranged to have overlap portions 
(hatched portions) at neighboring split positions (in 
Fig. 15A, the light-receiving portions are slightly vert- 
ically shifted for the sake of easy understanding). A 
sensitivity correction coefficient K1 of the image pick- s 
up element having the light-receiving portion b1 is cal- 
culated with reference to the output from the image 
pickup element having the light-receiving portion al. 
Then, a sensitivity correction coefficient K2 of the im- 
age pickup element having the light-receiving portion 10 
a2 is calculated with reference to the output from the 
image pickup element having the light-receiving por- 
tion b1. Similarly, a sensitivity correction coefficient 
K3 of the image pickup element having the light- 
receiving portion b2 is calculated. Thus, the sensitiv- 15 
ity correction coefficient K of the image pickup ele- 
ment having the light-receiving portion b2 with refer- 
ence to the output from the image pickup element hav- 
ing the light-receiving portion al is given by K = K1 x 
K2 x K3, and the sensitivity levels of the four image 20 
pickup elements can be adjusted using this coeffi- 
cient. Fig. 15B exemplifies a case wherein an image 
plane is split into eight portions using eight image 
pickup elements having light-receiving portions a1 to 
a4, and b1 to b4. In this case, sensitivity correction 25 
coefficients K1 to K7 are obtained in the same man- 
ner as described above, thus adjusting the sensitivity 
levels of all the image pickup elements. 

Fig. 16 is a diagram showing the fourth embodi- 
ment of the present invention. The same reference 30 
numerals in Fig. 16 denote the same parts as in Fig. 
10. Fig. 16 illustrates only an image pickup optical 
system. 

In the embodiment shown in Fig. 16, the number 
of split optical paths of image pickup light L is doubled, 35 
i.e., four as compared to the embodiment shown in 
Fig. 10, and three beam splitters 2a, 2b, and 2c are 
arranged. These beam splitters 2a, 2b, and 2c re- 
spectively have reflectances of 25% (1/4), 33% (1/3), 
and 50% (1/2), and supply beams L1, L2, L3, and L4 40 
having equal light amounts to four image formation 
planes A, B, C, and D, thus forming object images 
having the same size and the same brightness on the 
image formation planes A, B, C, and D. The object im- 
age on each of the image formation planes A, B, C, 45 
and D is split into a plurality of images, and light- 
receiving portions of image pickup elements (not 
shown) are arranged at non-neighboring split posi- 
tions of the images. Pieces of image information from 
these image pickup elements are synthesized to form so 
the entire object image. 

In the embodiment shown in Fig. 16, in practice, 
an object image is split into 1 6 images (4 x 4 in the hor- 
izontal and vertical directions) on each of the image 
formation planes A, B, C, and D, and the light- 55 
receiving portions of the image pickup elements are 
arranged at non- neigh boring four split positions on 
each image formation plane. For the sake of simplici- 



ty, a case will be exemplified wherein an image plane 
(object image) is split into four portions, as shown in 
Fig. 17, and these portions are respectively picked up 
by image pickup elements whose light-receiving por- 
tions a, b, c, and d are arranged on the image forma- 
tion planes A, B, C, and D. 

In this case, in order to adjust the sensitivity levels 
of the image pickup elements, the light-receiving por- 
tions a, b, c, and d also overlap each other in the im- 
age plane. Fig. 18A shows this state (in Fig. 18 A, the 
light-receiving portions are slightly shifted in the vert- 
ical and horizontal directions for the sake of easy un- 
derstanding). 

A sensitivity correction coefficient K1 of the light- 
receiving portion b is calculated with reference to the 
output from the image pickup element having the 
light-receiving portion a like in the above embodi- 
ment. At this time, outputs corresponding to the hatch- 
ed overlap portion shown in Fig. 18B are compared 
with each other like in the case shown in Figs. 13A to 
1 3E to calculate the coefficient K1 . Then, a sensitivity 
correction coefficient K2 of the image pickup element 
having the light-receiving portion c is calculated with 
reference to the output from the image pickup element 
having the light-receiving portion a. Similarly, a sen- 
sitivity correction coefficient K3 of the light-receiving - 
portion d is calculated with reference to the output 
from the image pickup element having the light- 
receiving portion a. In this case, the outputs corre- 
sponding to the hatched overlap portions shown in 
Figs. 18C and 18D are similarly compared to calcu- 
late the coefficients K2 and K3. 

Using the coefficients K1, K2, and K3 calculated 
as described above, the sensitivity levels of the four 
image pickup elements can be adjusted. Thus, the 
number of effective pixels can be increased like in the - 
above embodiment, and brightness nonuniformity 
can be eliminated. 

In this embodiment, the number of effective pix- 
els can be infinitely increased by extending the device 
in units of four image pickup elements shown in Fig. 
1 7 in the vertical and horizontal directions, and the re- 
solution can be theoretically infinitely increased. Fig. 
19A exemplifies a case wherein the image plane is 
split into 16 portions, as described above, and light- 
receiving portions a1 to a4, b1 to b4, d to c4, and d1 
to d4 of 16 image pickup elements are arranged. In 
this case, the number of effective pixels can be 16 
times that of a single image pickup element, and a re- 
solution equivalent to that obtained upon photograph- 
ing using an image pickup element having the number 
of pixels 16 times that of a conventional element, can 
be obtained. Fig. 19B shows a case wherein 64 (8 x 
8 in the horizontal and vertical directions) image pick- 
up elements are used. 

The above-mentioned image memories 141 and 
142 and the image synthesizing circuit 3 can be easily 
realized by using known memories and their control 
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techniques, which are normally used. Therefore, a de- 
tailed description of these memories and image syn- 
thesizing circuit will be omitted. In addition, more 
beam splitters than those in the above embodiment 
may be used to increase the number of split object im- 5 
ages on each image formation plane, thereby obtain- 
ing an image having a higher resolution. 

In a circuit arrangement used when the number 
of split image plane portions is larger than 2, the num- 
bers of image pickup units Xi (i = 1, 2,...)* overlap por- 10 
tion reading-out circuits, comparison circuits, and 
coefficient circuits can be increased in the circuit in 
Fig. 14, as needed. 

In this manner, when an image formation optical 
path used in, e.g., an existing industrial-use multi-bo- is 
ard camera is split into a plurality of paths by a beam 
splitter, the equivalent number of pixels can be greatly 
increased, and an image having higher image quality 
can be obtained. In addition, although a large number 
of image pickup elements are used, brightness nonu- 20 
nrformity caused by a variation in sensitivity can be 
prevented. 

As described above, according to the present in- 
vention, image pickup light from an object is split into 
a plurality of beams in equal light amounts, and object 25 
images are formed at different positions. The light- 
receiving portions of the image pickup elements are 
arranged at non-neighboring split positions so that 
each light-receiving portion partially overlaps the 
light-receiving portion at least at the neighboring split 30 
position of another image formation plane when an 
object image is split into a plurality of images on each 
image formation plane. The outputs corresponding to 
the overlap portion are compared to each other, and 
pieces of image information from the image pickup 35 
elements are synthesized while adjusting the sensitiv- 
ity levels of the image pickup elements. Thus, the 
number of effective pixels can be increased using 
conventional image pickup elements without using a 
high- integration image pickup element. At the same 40 
time, a variation in sensitivity among the image pickup 
elements can be corrected, and brightness nonuni- 
form ity can be eliminated. 

Fig. 20 is a diagram showing principal part of an 
image pickup device according to the fifth em bod i- 45 
ment of the present invention. The image pickup de- 
vice shown in Fig. 20 includes an imaging lens 1 
through which image pickup light L from an object 
passes, and a beam splitter 2 as split means for split- 
ting the image pickup light L into a plurality of beams so 
L1 and L2 in equal light amounts, and forming object 
images at different positions. The beam splitter 2 
comprises, e.g., a half mirror. The image pickup de- 
vice also includes a plurality of image pickup elements 
(e.g., CCDs) 100a and 100b, which have a plurality of ss 
light-receiving portions A1 and A2, and B1 and B2, 
which are split on a plane. These light-receiving por- 
tions Y1 and A2, and B1 and B2 are arranged on im- 



age formation planes 3a and 3b of the object images. 
In this case, the light-receiving portions A1 and A2, 
and B1 and B2 are located at non-neighboring split 
positions when an object image is split into a plurality 
of (in this case, four) images on each of the image for- 
mation planes 3a and 3b. More specifically, since the 
image pickup elements 100a and 100b are sealed in 
packages, an object image is split into a plurality of im- 
ages on each of the image formation planes 3a and 
3b, and the light-receiving portions A1 and A2, and B1 
and B2 are arranged at non-neighboring split posi- 
tions of the split images. The image pickup device 
also includes an image synthesizing circuit 4 for re- 
ceiving image information from the image pickup ele- 
ments 1 00a and 100b, and synthesizing the entire ob- 
ject image. 

In the image pickup device having the above- 
mentioned arrangement, the image pickup light L 
from an object through the lens 1 is guided as the 
beams L1 and L2 having equal light amounts along 
two optical paths split by the beam splitter 2, and the 
beams L1 and L2 reach the corresponding image for- 
mation planes (focal planes) 3a and 3b. Thus, object 
images having the same size and the same bright- 
ness are formed on the image formation planes 3a 
and 3b. Figs. 21 A and 21 B show states of the image 
formation planes 3a and 3b. Fig. 21 A shows the state 
of the image formation plane 3a, and Fig. 21 B shows 
the state of the image formation plane 3b. 

On each of the image formation planes 3a and 3b, 
an object image is split into four images. On the image 
formation plane 3a, light-receiving portions A1 and A2 
of the image pickup element 100a are respectively lo- 
cated at the first and third split positions which are not 
adjacent to each other. On the image formation plane 
3b, light-receiving portions B1 and B2 of the image 
pickup element 100b are respectively located at the 
second and fourth split positions which are not adja- 
cent to each other. Four pieces of image information 
photoelectrical I y converted by the image pickup ele- 
ments 100a and 100b are input to the image synthe- 
sizing circuit 4, and are synthesized, as shown in Fig. 
22, thereby forming a complete object image as a 
whole. 

The total number of effective pixels on the image 
formation planes 3a and 3b can be four times that of 
a single image pickup element, and a resolution 
equivalent to that obtained when an image pickup ele- 
ment having the number of pixels four times that of a 
conventional image pickup element, can be obtained, 
thus obtaining an image having improved image qual- 
ity. Since conventional image pickup elements used in 
a home video camera can be used without using a 
high- integration image pickup element, a low-cost im- 
age pickup device can be constituted by a simple cir- 
cuit 

Upon realization of the arrangement of the light- 
receiving portions A1 and A2, and B1 and B2 shown 
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in Figs. 21 A and 21 B t if the packages of the image 
pickup elements are sufficiently small, the light- 
receiving portions A1, A2, B1. and B2 can be consti- 
tuted by independent image pickup elements. How- 
ever, when the packages of the image pickup ele- 5 
ments are too large, it is impossible to arrange the 
light-receiving portions A1, A2, B1, and B2 using in- 
dependent image pickup elements since they inter- 
fere with each other. 

In this embodiment, the image pickup element 10 
100a whose light-receiving portion has a size corre- 
sponding to three out of four split portions is arranged 
on the image formation plane 3a, as indicated by a 
solid line in Fig. 23A. Of these three split portions, the 
light-receiving portions A1 and A2 are set on the two 15 
hatched portions in Fig. 23A. On the other hand, the 
image pickup element 100b whose light-receiving 
portion has a size corresponding to three out of four 
split portions is arranged on the image formation 
plane 3b, as indicated by a solid line in Fig. 23 B. Of 20 
these three split portions, the light-receiving portions 
B1 and B2 are set on the two hatched portions in Fig. 
23B. The size of each of the light-receiving portions 
A1 , A2, B 1 , and B2 is set to be equal to the image size 
(e.g., a 1/2" correspondence size) of a currently pop- 25 
ular image pickup element In this manner, the man- 
ufacturing equipment (including photomasks and the 
like) of the currently popular image pickup element 
can be used without modifications, and image pickup 
element chips shown in Figs. 23A and 23B can be 30 
manufactured with a high yield (since the manufactur- 
ing processes and the like are stable) without requir- 
ing high-grade manufacturing techniques and circuit 
techniques. 

Furthermore, since the alignment precision in a 35 
manufacturing apparatus of the image pickup element 
chip is very high, the relative positions between the 
light-receiving positions of the light-receiving portions 
A1 and A2, and B1 and B2 can be set with very high 
precision. Therefore, as an alignment operation of the 40 
light-receiving portions (including a falling direction), 
the alignment operations between the light-receiving 
portions A1 and A2, and between the light-receiving 
portions B1 and B2 need not be performed, and the 
positions of the image pickup element chips need only 45 
be adjusted. This is very preferable in terms of stabil- 
ity of light-receiving position precision including an 
environmental change and a change overtime. In ad- 
dition, an image pickup element chip having a large 
package can be used. so 

Fig. 24 is a diagram showing the sixth embodi- 
ment of the present invention. The same reference 
numerals in Fig. 24 denote the same parts as in Fig. 
20. Fig. 24 illustrates only an image pickup optical 
system. 55 

In the embodiment shown in Fig. 24, the number 
of split optical paths of image pickup light Lis doubled, 
i.e., four as compared to the embodiment shown in 



Fig. 20, and three beam splitters 2a, 2b, and 2c are 
arranged. These beam splitters 2a, 2b, and 2c re- 
spectively have reflectances of 25% (1/4), 33% (1/3), 
and 50% (1/2), and supply beams L1, L2, L3, and L4 
having equal light amounts to four image formation 
planes 3a, 3b, 3c, and 3d, thus forming object images 
having the same size and the same brightness on the 
image formation planes 3a, 3b, 3c, and 3d. The object 
image on each of the image formation planes 3a, 3b, 
3c, and 3d is split into a plurality of images, and light- 
receiving portions of image pickup elements (not 
shown), which are the same as the image pickup ele- 
ments 100a and 100b shown in Fig. 20, are arranged 
at non-neighboring split positions of the images. 
Pieces of image information from these image pickup 
elements are synthesized to form the entire object im- 
age. 

In the embodiment shown in Fig. 24, an object im- 
age is split into 16 images (4 x 4 in the horizontal and 
vertical directions) on each of the image formation 
planes 3a, 3b, 3c, and 3d, as shown in Figs. 25A to 
25D. The light-receiving portions of the image pickup 
elements are arranged at non-neighboring four split 
positions on each image formation plane. More spe- 
cifically, on the image formation plane 3a shown in 
Fig. 25A, light-receiving portions A1, A2 f A3, and A4 
are respectively arranged at the first, third, ninth, and 
eleventh positions. On the image formation plane 3b 
shown in Fig. 25B, light-receiving portions B1, B2, B3, 
and B4 are respectively arranged at the second, 
fourth, tenth, and twelfth positions. On the image for- 
mation plane 3c shown in Fig. 25C, light-receiving 
portions C1, C2, C3, and C4 are respectively ar- 
ranged at the fifth, seventh, thirteenth, and fifteenth 
positions. On the image formation plane 3d shown in 
Fig. 25D, light-receiving portions D1, D2, D3, and D4 
are respectively arranged at the sixth, eighth, four- 
teenth, and sixteenth positions. 

Image information of an object, which is sepa- 
rately picked up by the 16 light-receiving portions A1 
to A4, B1 to B4, C1 to C4, and D1 to D4 in the above- 
mentioned arrangement states of the image pickup 
elements on the image formation planes 3a, 3b, 3c, 
and 3d, is synthesized by the image synthesizing cir- 
cuit, as described above. Fig. 26 shows the state of 
the synthesized image information, and illustrates 
contributions of the respective light- receiving portions 
to the object image. In this embodiment, the number 
of effective pixels on the image formation planes 3a, 
3b, 3c, and 3d is 1 6 times that of a single image pickup 
element, and a resolution equivalent to that obtained 
when an image pickup element having the number of 
pixels 16 times that of a conventional image pickup 
element, can be obtained, thus obtaining an image 
with higher image quality than that of the embodiment 
shown in Fig. 20. 

Upon realization of the arrangements shown in 
Figs. 25A to 25D like in the embodiment shown in Fig. 
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20, when the packages of the image pickup elements 
are sufficiently small, the 16 light-receiving portions 
A1 to A4, B1 to B4, C1 to C4, and D1 to D4 can be con- 
stituted by independent image pickup elements. How- 
ever, when the size of the package of the image pick- s 
up element is too large, it is similarly impossible to ob- 
tain the above-mentioned arrangements of the light- 
receiving portions using the independent image pick- 
up elements. 

Like in the embodiment shown in Fig. 20, an im- w 
age pickup element chip a whose light-receiving por- 
tion has a size corresponding to nine out of 16 split 
portions is arranged on the image formation plane 3a, 
as indicated by a solid line in Fig. 27 A, and the light- 
receiving portions A1 to A4 are set on the four hatched 15 
portions of the these split portions. An image pickup 
element chip b whose light-receiving portion has a 
size corresponding to nine out of 16 split portions is 
arranged on the image formation plane 3b, as indicat- 
ed by a solid line in Fig. 27B, and the light-receiving 20 
portions B1 to B4 are set on the four hatched portions 
of the these split portions. An image pickup element 
chip c whose light-receiving portion has a size corre- 
sponding to nine out of 16 split portions is arranged 
on the image formation plane 3c, as indicated by a 25 
solid line in Fig. 27C, and the light-receiving portions 
C1 to C4 are set on the four hatched portions of the 
these split portions. Similarly, an image pickup ele- 
ment chip d whose light-receiving portion has a size 
corresponding to nine out of 16 split portions is ar- 30 
ranged on the image formation plane 3d, as indicated 
by a solid line in Fig. 27D, and the light-receiving por- 
tions D1 to D4 are set on the four hatched portions of 
the these split portions. 

Like in the embodiment shown in Fig. 20, the size 35 
of each of the light-receiving portions A1 to A4, B1 to 
B4, C1 to C4, and D1 to D4 is set to be equal to the 
image size (e.g., a 1/2" correspondence size) of a 
currently popular image pickup element. In this man- 
ner, the manufacturing equipment (including photo- 40 
masks and the like) of the currently popular image 
pickup element can be used without modifications, 
and the image pickup element chips a to d shown in 
Figs. 27A to 27D can be manufactured with a high 
yield (since the manufacturing processes and the like 45 
are stable). 

Furthermore, since the alignment precision in a 
manufacturing apparatus of the image pickup element 
chip is very high, the relative positions of the light- 
receiving positions of the light-receiving portions A1 so 
to A4, B1 to B4, C1 to C4, and D1 to D4 can be set 
with very high precision. Therefore, as an alignment 
operation of the light-receiving portions (including a 
falling direction), the alignment operations among the 
light-receiving portions A1 to A4, B1 to B4, C1 to C4, 55 
and D1 to D4 need not be performed, and the posi- 
tions of the image pickup element chips a, b, c, and d 
need only be adjusted. This is very preferable in 



terms of stability of light-receiving positional precision 
including an environmental change and a change 
over time. 

Fig. 28 is a block diagram showing a detailed cir- 
cuit arrangement of the image pickup device having 
the arrangement shown in Fig. 20. The image pickup 
device shown in Fig. 28 includes an image pickup unit 
X1. The image pickup unit X1 comprises an image 
pickup element (e.g., a CCD) 101 shown in Fig. 20, a 
driver 111 for driving the image pickup element 101, 
an S/H circuit 121 for sampling and holding an output 
from the image pickup element 101, an A/D converter 
1 31 for converting sampled/held analog image infor- 
mation into a digital signal, and an image memory 141 
for storing the digital image information. The image 
pickup device also includes image pickup units X2, 
X3, and X4 having the same arrangement as that of 
the image pickup unitXL More specifically, the image 
pickup units X2, X3, and X4 respectively comprise im- 
age pickup elements 102, 1 03, and 104 shown in Fig. 
20, drivers 112, 113, and 114, S/H circuits 122, 123, 
and 124, A/D converters 132, 133, and 134, and im- 
age memories 142, 143, and 144 like in the image 
pickup unitXI . The image pickup device also includes 
a single clock generation circuit 5. The operation tim- 
ings of the drivers 111 to 114, the S/H circuits 121 to 
124, the A/D converters 131 to 134, and the image 
memories 141 to 144 of the image pickup units X1 to 
X4 are controlled by a timing signal output from the 
clock generation circuit 5. In addition, the driving op- 
erations of the image pickup elements 101 to 104 
(100a and 100b) are also controlled by this tiring sig- 
nal. The operation of an image synthesizing circuit 4 
is also controlled by the timing signal from the clock 
generation circuit 5. An image signal from an output 
terminal 6 is output to a display or a recorder (not 
shown). 

The image pickup elements 1 00a and 1 00b of the 
image pickup units X1 to X4 respectively have the 
light-receiving portions A1, B1, A2, and B2 shown in 
Figs. 21 A and 21 B, and Fig. 22, and pieces of image 
information of the four split object images described 
above are respectively stored in the image memories 
141 to 144. The pieces of image information stored in 
the image memories 141 to 144 are read out in re- 
sponse to the signal from the clock generation circuit 
5, and are input to the image synthesizing circuit 4. 
The image synthesizing circuit 4 synthesizes the im- 
age information of the overall object, and an image 
signal obtained by picking up an object is output from 
the output terminal 6. 

The circuit arrangement of the image pickup de- 
vice having the arrangement shown in Fig. 24 can be 
realized by arranging 1 6 image pickup units shown in 
Fig. 28. Pieces of image information from the image 
pickup units need only be input to the image synthe- 
sizing circuit to form the overall object image. 

The above-mentioned image memories 141 to 
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144 and the image synthesizing circuit 4 can be easily 
realized by using known memories and their control 
techniques, which are normally used. Therefore, a de- 
tailed description of these memories and image syn- 
thesizing circuit will be omitted. In addition, more 5 
beam splitters than those In the above embodiment 
may be used to increase the number of split object im- 
ages on each image formation plane, thereby obtain- 
ing an image having a higher resolution. 

In the embodiment shown in Fig. 20, when the 10 
light-receiving portions are arranged in the horizontal 
direction in units of two image pickup elements shown 
in Fig. 29, the number of effective pixels in the hori- 
zontal direction of the image pickup elements can be 
infinitely increased, and the resolution can be theoret- 15 
ically infinitely improved in the horizontal direction. 
Figs. 30A and 30B show a case wherein eight image 
pickup elements are used, and Fig. 31 shows a state 
of synthesized image information from these image 
pickup elements. In this case, when hatched portions 20 
of Figs. 30Aand 30B are constituted by independent 
image pickup elements, the elements cannot often be 
arranged since they interfere with each other. In this 
case, when light-receiving portions are arranged at 
non- neigh boring positions on a single image pickup 25 
element chip, as indicated by hatched portions in 
Figs. 32Aand 32B f an image pickup element chip free 
from problems of relative positions and flatness can 
be constituted. Similarly, when the positional relation- 
ship shown in Figs. 29 to 32B is rotated through 90°, 30 
the number of effective pixels can be similarly in- 
creased in the vertical direction. 

In the embodiment shown in Fig. 24, when the 
light-receiving portions are arranged in the vertical 
and horizontal directions in units of four image pickup 35 
elements shown in Fig. 33, the number of effective 
pixels of the image pickup elements can be infinitely 
increased, and the resolution can be theoretically in- 
finitely improved. Figs. 34A to 34D show a case 
wherein 64 (= 8 x 8) image pickup elements are used, 40 
and Fig. 35 shows a state of synthesized image infor- 
mation from these image pickup elements. In this 
case, when hatched portions of Figs. 34 A to 34D are 
constituted by independent image pickup elements, 
the elements cannot often be arranged since they in- 45 
terfere with each other. In this case, when light- 
receiving portions are arranged at non- neigh boring 
positions on a single image pickup element chip, as 
indicated by hatched portions in Figs. 36 A to 36D, an 
image pickup element chip free from problems of rel- so 
ative positions and flatness can be constituted. 

In this manner, when an image formation optical 
path used in, e.g., an existing industrial-use multi-bo- 
ard camera is split into a plurality of paths by a beam 
splitter, the equivalent number of pixels can be greatly ss 
increased, and an image having higher image quality 
can be obtained. For example, when an image pickup 
element having four hundred thousand pixels and 



used in an existing home video camera is adopted in 
the present invention, the number of pixels can reach 
1.6 millions in the embodiment shown in Fig. 20, and 
can reach 6.4 millions in the embodiment shown in 
Fig. 24. When the image size is further increased, the 
number of effective pixels can be infinitely increased. 

Furthermore, since each image formation plane 
can be formed by a single image pickup element chip 
in which light-receiving elements each having a size 
equal to that of a consumer-use image pickup ele- 
ment, which is technically sufficiently established, are 
arranged at non-neighboring positions, a manufactur- 
ing apparatus (including photomasks) and manufac- 
turing processes of the consumer-use image pickup 
element can be commonly used. In addition, an image 
pickup element having high performance in view of 
the relative positional precision of the light-receiving 
portions, flatness, and the like can be manufactured 
with a high yield. Since a single image pickup element 
chip (with a plurality of light-receiving portions) is ar- 
ranged on each image formation plane, the image 
pickup element chip (light-receiving portions) can be 
aligned with remarkably higher precision and stability 
than those in a case wherein the light-receiving por- 
tions are constituted by independent image pickup 
element chips. 

The operation frequency of the device of the pres- 
ent invention can be as low as that used in an existing 
home video camera, and a high frequency required in 
a M hi-vision n camera is not necessary. Thus, the de- 
vice of the present invention can be easily realized by 
circuit members and techniques used in conventional 
devices. 

As described above, according to the present in- 
vention, image pickup light from an object is split into 
a plurality of beams in equal light amounts, and object 
images are formed at different positions. The light- 
receiving portions of the image pickup elements each 
having a plurality of light-receiving portions split on a 
plane are arranged at non-neighboring split positions 
when the object image is split into a plurality of images 
on each image formation plane, and pieces of image 
information are synthesized later. Thus, the number 
of effective pixels can be increased using convention- 
al image pickup elements without using a high- 
integration image pickup element, and image quality 
can be improved. In addition, high-grade manufactur- 
ing techniques and circuit techniques are not re- 
quired, and even an image pickup element having a 
large package can be used. 

Fig. 37 is a diagram showing principal part of an 
image pickup device according to the seventh em- 
bodiment of the present invention. The image pickup 
device shown in Fig. 37 includes an imaging lens 1 
through which image pickup light L from an object 
passes, and a beam splitter 2 as split means for split- 
ting the image pickup light L into a plurality of beams 
L1 and L2 in equal light amounts, and forming object 
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images at different positions. The beam splitter 2 
comprises, e.g., a half mirror. The image pickup de- 
vice also includes a plurality of image pickup elements 
(e.g., CCDs) 101 to 104 whose light-receiving por- 
tions are arranged on image formation planes A and 
B of the split object images. The light-receiving por- 
tions are arranged at non-neighboring split positions 
when an object image is split into a plurality of images 
(in this case, four images) on each of the image for- 
mation planes Aand B. More specifically, since the im- 
age pickup elements 101 to 104 are sealed in pack- 
ages, an object image is split into a plurality of images 
on each of the image formation planes A and B, and 
the image pickup elements 101 to 104 are arranged 
at non-neighboring positions so as not to interfere 
with each other. The image pickup device also in- 
cludes an image synthesizing circuit 3 for receiving 
image information from the image pickup elements 
101 to 104 to synthesize the entire object image. 

The image pickup device also includes a focus 
driving circuit (adjusting means) 1 0 for performing au- 
tomatic focus adjustment, an iris 11 for setting an in- 
cident light amount (exposure condition), and an iris 
driving circuit (adjusting means) 12 for performing au- 
tomatic exposure adjustment, i.e., for controlling the 
aperture size of the iris 11. 

In the image pickup device having the above- 
mentioned arrangement, the image pickup light L 
from an object through the lens 1 is guided as the 
beams L1 and L2 having equal light amounts along 
two optical paths split by the beam splitter 2, and the 
beams L1 and L2 reach the corresponding image for- 
mation planes (focal planes) Aand B. Thus, object im- 
ages having the same size and the same brightness 
are formed on the image formation planes A and B. 
Figs. 38 A and 38B show states of the image formation 
planes Aand B. Fig. 38A shows the state of the image 
formation plane A, and Fig. 38B shows the state of the 
image formation plane B. 

On each of the image formation planes A and B, 
an object image is split into four images. On the image 
formation plane A, light-receiving portions al and a2 
of the image pickup elements 101 and 103 are respec- 
tively located at the first and third split positions which 
are not adjacent to each other. On the image forma- 
tion plane B, light-receiving portions b1 and b2 of the 
image pickup elements 102 and 104 are respectively 
located at the second and fourth split positions which 
are not adjacent to each other. Four pieces of image 
information photoelectrically converted by the image 
pickup elements 101 to 104 are input to the image 
synthesizing circuit 3, and are synthesized, as shown 
in Fig. 39, thereby forming a complete object image 
as a whole. 

The total number of effective pixels on the image 
formation planes A and B can be four times that of a 
single image pickup element, and a resolution equiv- 
alent to that obtained when an image pickup element 



having the number of pixels four times that of a con- 
ventional image pickup element, can be obtained, 
thus obtaining an image having improved image qual- 
ity. Since conventional image pickup elements used in 
5 a home video camera can be used without using a 
high- integration image pickup element, a low-cost im- 
age pickup device can be constituted by a simple cir- 
cuit 

Fig. 40 is a block diagram showing a circuit ar- 

10 rangement of an image pickup unit Xi having the im- 
age pickup element shown in Fig. 37. The image pick- 
up unit Xi in Fig. 40 comprises an image pickup ele- 
ment (e.g., a CCD) 110 shown in Fig. 37, a driver 111 
for driving the image pickup element 110, an S/H cir- 

15 cuit 112 for sampling and holding an output from the 
image pickup element 110, an A/D converter 113 for 
converting sampled/held analog image information 
into a digital signal, and an image memory 114 for 
storing the digital image information. The output from 

20 the image pickup unit Xi with the above-mentioned ar- 
rangement is input to the image synthesizing circuit 3 
shown in Fig. 37. A single clock generation circuit 115 
is connected to the image pickup unit Xi. A timing sig- 
nal output from the clock generation circuit 115 con- 

25 trols the operation timings of the driver 111, the S/H 
circuit 112, the A/D converter 113, and the image 
memory 114. The driving operation of the image pick- 
up element 11 0 is also controlled by this timing signal. 
The operation of the image synthesizing circuit 3 is 

30 also controlled by the timing signal from the clock gen- 
eration circuit 115, and an image signal output from 
the image synthesizing circuit 3 is output to a display 
or a recorder (not shown). 

Fig. 41 is a block diagram showing a detailed cir- 

35 cuit arrangement of the image pickup device having 
the arrangement shown in Fig. 37. In Fig. 41, image 
pickup units X1 to X4 have the same arrangement as 
that of the image pickup unit Xi (i = 1, 2, 3, 4) shown 
in Fig. 40, and respectively have the above- 

40 mentioned light-receiving portions a1 , a2, b1 , and b2. 
The operation timings of these image pickup ele- 
ments 101 to 104 are controlled by the clock genera- 
tion circuit 115. 

The output terminal of the image pickup unit X1 

45 is connected to a luminance signal integrating circuit 
203 for integrating luminance signals for one frame 
from the image pickup element 101 having the light- 
receiving portion al to obtain an average amount of 
light incident on the image pickup element 101. The 

so output terminal of the luminance signal integrating cir- 
cuit 203 is connected to a comparison circuit 204 for 
comparing the average amount of light incident on the 
image pickup element 101 with a prescribed value to 
determine whether the average amount falls within a 

55 predetermined range from the prescribed value or is 
larger or smaller than the prescribed value exceeding 
the predetermined range. The output from the com- 
parison circuit 204 is input to the iris driving circuit 12. 
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The output terminal of the image pickup unit X1 
is also connected to a high-pass filter (HPF) 205. The 
output terminal of the HPF 205 is connected to a 
memory 206 for storing a maximum value of data for 
one frame, and one input terminal of a comparison cir- 
cuit 207. The output terminal of the memory 206 is 
connected to the other input terminal of the compari- 
son circuit 207. The output terminal of the comparison 
circuit 207 is connected to the focus driving circuit 1 0. 

The output terminals of the image pickup units X1 
to X4 are connected to the image synthesizing circuit 
3, and the output from the image synthesizing circuit 
3 serves as a final output. In this case, the operation 
timings of all the elements shown in Fig. 41 are con- 
trolled by the clock generation circuit 115. 

Fig. 42 shows a general flow of an image pickup 
operation of the circuit shown in Fig. 41. When the im- 
age pickup operation is started, only one of the image 
pickup elements, e.g., only the image pickup unit X1 
of the image pickup element 101 is energized (step 
S1), and exposure and focus setting operations are 
performed by utilizing the output from the image pick- 
up element 101 (step S2). Thereafter, the remaining 
image pickup units X2 to X4 are energized (step S3) 
to perform a photographing operation (step S4). 

When the plurality of image pickup elements 101 
to 104 are used to increase the number of pixels, pow- 
er consumption is also increased in proportion to an 
increase in the number of pixels, thus posing prob- 
lems of heat generation and a power supply counter- 
measure when an internal battery is used. In this em- 
bodiment, photographing conditions (e.g., exposure 
and focus setting operations) are set by utilizing the 
output from one of the image pickup elements. For this 
reason, power consumption can be saved, and a de- 
vice having a high power saving effect can be real- 
ized. 

The photographing operation will be described in 
detail below. 

When only the image pickup unitXI is energized, 
the luminance signal integrating circuit 203 connected 
to the output terminal of the image pickup unit X1 in- 
tegrates luminance signals for one frame from the im- 
age pickup element 101 to obtain an average amount 
of light incident on the image pickup element 1 01 , and 
the comparison circuit 204 then compares the aver- 
age amount of light incident on the image pickup ele- 
ment 101 with a prescribed value to discriminate 
whether the average value falls within a predeter- 
mined range from the prescribed value or is larger or 
smaller than the prescribed value exceeding the pre- 
determined range. When the discrimination result of 
the comparison circuit 204 indicates that the average 
amount of light incident on the image pickup element 
101 is larger than the prescribed value exceeding the 
predetermined range, the iris 11 is stopped down 
based on the output from the comparison circuit 204 
through the iris driving circuit 12. When it is deter- 



mined that the average amount of light incident on the 
image pickup element 101 is smaller than the prescri- 
bed value exceeding the predetermined range, the 
iris 11 is opened based on the output from the com- 

5 pans on circuit 204 through the iris driving circuit 12. 
If it is determined that the average amount of tight in- 
cident on the image pickup element 101 falls within 
the predetermined range from the prescribed value, 
the output from the comparison circuit 204 does not 

10 drive the iris driving circuit 1 2, and the aperture value 
of the His 11 is left unchanged. In this manner, an ex- 
posure condition is set. 

In the focus setting operation, outputs from the 
image pickup unit X1 are read out for one frame, and 

15 a maximum value of the outputs from the HPF 205 for 
one frame is stored in the memory 206. Then, the lens 
is driven through the focus driving circuit 10, so that 
the focal point is set at the near-focus side by a pre- 
determined amount Thereafter, outputs from the im- 

20 age pickup unit X1 are read out for one frame again, 
and the comparison circuit 207 compares the outputs 
from the HPF 205 for one frame with the immediately 
preceding maximum value stored in the memory 206. 
If it is determined that the maximum value of the cur- 

25 rently readout outputs from the HPF 205 is larger than 
the immediately preceding maximum value stored in 
the memory 206 by a predetermined value or more, 
it can be considered that the focal point can be more 
satisfactorily adjusted in the current state than that in 

30 the immediately preceding state. Thus, the lens is 
driven through the focus driving circuit 10, so that the 
focal point is set at the near-focus side by another pre- 
determined amount. Thereafter, the outputs from the 
image pickup unit X1 for one frame are read out, and 

35 the same operation as described above is repeated. 

If it is determined that the maximum value of the 
currently readout outputs from the HPF 205 is larger 
than the immediately preceding maximum value stor- 
ed in the memory 206 by a predetermined value or 

40 more, the focal point in the current state is shifted 
more than that in the immediately preceding state. 
Thus, the lens is driven through the focus driving cir- 
cuit 10, so that the focal point is set at the far-focus 
side by a predetermined amount. Thereafter, the out- 

45 puts from the image pickup unit X1 for one frame are 
read out, and the same operation as described above 
is repeated. 

If it is determined that the maximum value of the 
currently readout outputs from the HPF 205 falls with- 

50 in a predetermined range from the immediately pre- 
ceding maximum value stored in the memory 206, the 
focal point is substantially adjusted. Thus, the focus 
driving circuit 10 is not driven, and the current focal 
point position is left unchanged. In this manner, the fo- 

55 cus setting operation is completed. In the above set- 
ting operations, since an operation for correcting a 
shift in focal point is repeated, the focal point can be 
finally adjusted. 
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Upon completion of the exposure condition and 
focus setting operations, as described above, all the 
image pickup units X1 to X4 are energized to perform 
a photographing operation. When a main exposure 
operation is performed, four split object image por- 
tions are respectively stored in the image memories 
of the image pickup units X1 to X4. These pieces of 
image information are read out by the image synthe- 
sizing circuit 3, and are synthesized in the pattern 
shown in Fig. 39. Thereafter, the synthesized infor- 
mation is output to an output terminal as a final output. 
In this case, the operation timing of the image synthe- 
sizing circuit 3 is also controlled by the clock genera- 
tion circuit 115. 

When white balance adjustment is to be addition- 
ally performed in the above embodiment the image 
pickup unit X1 shown in Fig. 40 can be replaced with 
the circuit shown in Fig. 43, and each of the image 
pickup units X2 to X4 can be replaced with the circuit 
shown in Fig. 44, thus realizing white balance adjust- 
ment. 

In Fig. 43, the image pickup element 110 and its 
driver 111 are the same as those shown in Fig. 40. 
Color filters are adhered to the image pickup element 
110, and pieces of information from the color filters, 
which are spatially arranged, are time-serially read 
out. For this reason, these pieces of information are 
input to a color separation circuit 301 to separate color 
components (R, G, and B). The color-separated sig- 
nals are sampled and held by S/H circuits 112a to 
112c. Of the outputs from the S/H circuits 112a to 
1 1 2c, R and B components are input to white balance 
adjustment variable gain amplifiers (GCs) 302a and 
302b. The output from the R-component variable gain 
amplifier 302a and the output from the G-component 
S/H circuit 112b are supplied to the two input termi- 
nals of an integration comparison circuit 303a for gen- 
erating an R component white balance control signal. 
The output from the integration comparison circuit 
303a is input to the gain control terminal of the vari- 
able gain amplifier 302a. The output from the variable 
gain amplifier 302a is input to the image memory 114 
through an A/D converter 113a. 

The output from the B-component variable gain 
amplifier 302b and the output from the G-component 
S/H circuit 112b are supplied to the two input termi- 
nals of an integration comparison circuit 303b for gen- 
erating a B-component white balance control signal. 
The output from the integration comparison circuit 
303b is input to the gain control terminal of the vari- 
able gain amplifier 302b. The output from the variable 
gain amplifier 302b is input to the image memory 114 
through an A/D converter 114c. 

The output from the G-component S/H circuit 
112b is directly input to the image memory 114 
through an A/D converter 113b. The image memory 
114 stores image information for one frame of the im- 
age pickup element 110. 



Fig. 44 shows substantially the same arrange- 
ment as that shown in Fig. 43, except that the integra- 
tion comparison circuits 303a and 303b shown in Fig. 
43 are omitted, and the gain control terminals of the 

5 variable gain amplifiers 302a and 302b are directly 
connected to the output terminals of the integration 
comparison circuits 303a and 303b shown in Fig. 43, 
so that gain control is performed according to the sig- 
nals input from the integration comparison circuits 

10 303a and 303b. 

The operations of the circuits shown in Figs. 43 
and 44 will be described below. The operation flow is 
substantially the same as that shown in Fig. 42, ex- 
cept that white balance adjustment is performed in 

15 place of the exposure and focus setting operations 
executed in step S2. Thus, only this operation will be 
described below. 

In Fig. 43, information time-serially read out from 
the color filters of the image pickup element 110 is 

20 separated into color components (R, G, and B) by the 
color separation circuit 301. The color-separated sig- 
nals are sampled and held by the S/H circuits 112a to 
112c. Of the outputs from the S/H circuits 112a to 
112c, R and B components are input to the variable 

25 gain amplifiers 302a and 302b for white balance ad- 
justment. The output from the R-component variable 
gain amplifier 302a and the output from the G-compo- 
nent S/H circuit 112b are input to the two input termi- 
nals of the integration comparison circuit 303a for 

30 generating an R-component white balance control 
signal, so that the average values of R and G compo- 
nent signals for one frame are compared by the inte- 
gration comparison circuit 303a. At this time, if the 
average value of the R component signals for one 

35 frame is larger than the average value of the G com- 
ponent signals by a predetermined value or more, the 
output from the integration comparison circuit 303a is 
set to be a value smaller than the current value by the 
predetermined value, thereby decreasing the gain of 

40 the variable gain amplifier 302a from the current val- 
ue by a predetermined value. However, if the average 
value of the R component signals for one frame is 
smaller than the average value of the G component 
signals by a predetermined value or more, the output 

45 from the integration comparison circuit 303a is set to 
be a value larger than the current value by the prede- 
termined value, thereby increasing the gain of the va- 
riable gain amplifier 302a by a predetermined value. 
When it is determined according to the comparison 

so result that the difference between the two average 
values falls within a predetermined range, since the 
G and R components are balanced, the output from 
the integration comparison circuit 303a maintains the 
current value. 

55 The output from the B-component variable gain 

amplifier 302b and the output from the G-component 
S/H circuit 112b are input to the two input terminals of 
the integration comparison circuit 303b for generating 
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a G-component white balance control signal, so that 
the average values of B and G component signals for 
one frame are compared by the integration compari- 
son circuit 303b. At this time, if the average value of 
the B component signals for one frame is larger than 
the average value of the G component signals by a 
predetermined value or more, the output from the in- 
tegration comparison circuit 303b is set to be a value 
smaller than the current value by the predetermined 
value, thereby decreasing the gain of the variable gain 
amplifier 302b from the current value by a predeter- 
mined value. However, if the average value of the B 
component signals for one frame is smaller than the 
average value of the G component signals by a pre- 
determined value or more, the output from the integra- 
tion comparison circuit 303b is set to be a value larger 
than the current value by the predetermined value, 
thereby increasing the gain of the variable gain ampli- 
fier 302b by a predetermined value. When it is deter- 
mined according to the comparison result that the dif- 
ference between the two average values fails within 
a predetermined range, since the G and B compo- 
nents are balanced, the output from the integration 
comparison circuit 303b maintains the current value. 

In the above operation, a white balance shift in 
any direction can be corrected for both the R and B 
components, and when white balance is attained, the 
balance state is maintained. As a result, a correct 
white balance can be attained finally. 

In this manner, after the white balance adjust- 
ment is performed in step S2 in Fig. 42, the image 
pickup units X2 to X4 each having the arrangement 
shown in Fig. 44 are energized. At this time, the con- 
trol inputs of the variable gain amplifiers 302a and 
302b are the outputs from the integration comparison 
circuits 303a and 303b in Fig. 43, as described above 
(step S3). 

When a main exposure operation is performed, 
four split object image portions are respectively stor- 
ed in the image memories of the image pickup units 
X1 to X4. These pieces of image information are read 
out by the image synthesizing circuit 3, and are syn- 
thesized in the pattern shown in Fig. 39 (step S4). 

Fig. 45 is a diagram showing the eighth embodi- 
ment of the present invention. The same reference 
numerals in Fig. 45 denote the same parts as in Fig. 
37. Fig. 45 illustrates only an image pickup optical 
system. 

In the embodiment shown in Fig. 45, the number 
of split optical paths of image pickup light Lis doubled, 
i.e., four as compared to the embodiment shown in 
Fig. 37, and three beam splitters 2a, 2b, and 2c are 
arranged. These beam splitters 2a, 2b, and 2c re- 
spectively have reflectances of 25% (1/4), 33% (1/3), 
and 50% (1/2), and supply beams L1, L2, L3, and L4 
having equal light amounts to four image formation 
planes A, B, C, and D, thus forming object images 
having the same size and the same brightness on the 



image formation planes A, B, C, and D. The object im- 
age on each of the image formation planes A, B, C f 
and D is split into a plurality of images, and light- 
receiving portions of image pickup elements (not 

5 shown) are arranged at non-neighboring split posi- 
tions of the images. Pieces of image information from 
these image pickup elements are synthesized to form 
the entire object image. 

In the embodiment shown in Fig. 45, an object im- 

10 age is split into 16 images (4 x 4 in the horizontal and 
vertical directions) on each of the image formation 
planes A, B, C, and D, as shown in Figs. 46A to 46D. 
The light-receiving portions of the image pickup ele- 
ments are arranged at non-neighboring four split pos- 
ts itions on each image formation plane. More specifi- 
cally, on the image formation plane A shown in Fig. 
46A, light-receiving portions a1 , a2, a3, and a4 are re- 
spectively arranged at the first, third, ninth, and elev- 
enth positions. On the image formation plane B 

20 shown in Fig. 46B, light-receiving portions b1, b2, b3, 
and 64 are respectively arranged at the second, 
fourth, tenth, and twelfth positions. On the image for- 
mation plane C shown in Fig. 46C, light-receiving por- 
tions d, c2, c3, and c4 are respectively arranged at 

25 the fifth, seventh, thirteenth, and fifteenth positions. 
On the image formation plane D shown in Fig. 46D, 
light-receiving portions d1, d2, d3, and d4 are respec- 
tively arranged at the sixth, eighth, fourteenth, and 
sixteenth positions. 

30 Image information of an object, which is sepa- 

rately picked up by the 16 light-receiving portions a1 
to a4, b1 to b4, c1 to c4, and d1 to d4 in the above- 
mentioned arrangement states of the image pickup 
elements on the image formation planes A, B, C, and 

35 D, is synthesized by the image synthesizing circuit, as 
described above. Fig. 47 shows the state of the syn- 
thesized image information, and illustrates contribu- 
tions of the respective light-receiving portions to the 
object image. In this embodiment, the number of ef- 

40 fective pixels on the image formation planes A, B, C, 
and D is 16 times that of a single image pickup ele- 
ment, and a resolution equivalent to that obtained 
when an image pickup element having the number of 
pixels 16 times that of a conventional image pickup 

45 element, can be obtained, thus obtaining an image 
with higher image quality than that of the embodiment 
shown in Fig. 37. 

Like in the embodiment shown in Fig. 37, auto- 
matic focus adjustment and automatic exposure ad- 

so justment are performed by a focus driving circuit 10 
and an iris driving circuit 12. In this case, since these 
adjustment operations are performed by utilizing the 
output from one of image pickup elements, power 
consumption can be saved, and the same effect as in 

55 the embodiment shown in Fig. 37 can be obtained. 

Fig. 48 is a block diagram showing a circuit ar- 
rangement of the image pickup device having the ar- 
rangement shown in Fig. 45. The same reference nu- 
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merals in Fig. 45 denote the same parts as in Fig. 41 . 
More specifically, in this circuit, the number of image 
pickup units Xi in the circuit shown in Fig. 41 is in- 
creased from 4 to 16, and the operation flow is the 
same as that shown in Fig. 42. 

In the embodiment shown in Fig. 37, when the 
light-receiving units a1 and b1 are arranged in the 
horizontal direction in units shown in Fig. 49 A, the 
number of image pickup elements can be infinitely in- 
creased. Fig. 49B shows a case wherein a total of 
eight light-receiving portions a and b are arranged in 
the horizontal direction. The arrangement in the vert- 
ical direction can be realized by rotating the above- 
mentioned pattern shown in Fig. 49A through 90°. 

In the embodiment shown in Fig. 45, when the 
light-receiving units a1, b1, c1 and d1 are arranged in 
the vertical and horizontal directions in units shown in 
Fig. 50A, the number of image pickup elements can 
be infinitely increased. Fig. 50B shows a case where- 
in a total of 64 light-receiving portions a, b, c, and d 
are arranged. 

In these extended examples shown in Figs. 49A 
to 50B, an electrical circuit for driving these elements 
can be easily realized by increasing the number of im- 
age pickup units having the circuit shown in Fig. 41 in 
correspondence with the number of image pickup ele- 
ments. 

In this manner, when an image formation optical 
path used in, e.g., an existing industrial-use multi-bo- 
ard camera is split into a plurality of paths by a beam 
splitter, the equivalent number of pixels can be greatly 
increased, and an image having higher image quality 
can be obtained. Since photographing conditions are 
set by utilizing the output from one of the image pickup 
elements, a high power saving effect can be obtained. 

As described above, according to the above- 
mentioned embodiments, image pickup light from an 
object is split into a plurality of beams in equal light 
amounts, and object images are formed at different 
positions. The light-receiving portions of the image 
pickup elements are arranged at non- neigh boring 
split positions when the object image is split into a 
plurality of images on each image formation plane, 
and pieces of image information are synthesized lat- 
er. Thus, the number of effective pixels can be in- 
creased using conventional image pickup elements 
without using a high-integration image pickup ele- 
ment, and image quality can be improved. In addition, 
power consumption can be saved, and a high power 
saving effect can be obtained. 

Fig. 51 is a diagram showing principal part of an 
image pickup device according to the ninth embodi- 
ment of the present invention. The image pickup de- 
vice shown in Fig. 51 includes an imaging lens 1 
through which image pickup light L from an object 
passes, and beam splitters 2a, 2b, and 2c serving as 
split means for splitting the image pickup light L into 
a plurality of beams L1, L2, L3, and L4 in equal light 



amounts, and forming object images at different pos- 
itions. Each of these beam splitters 2a, 2b, and 2c 
comprises, e.g., a half mirror. The beam splitters 2a, 
2b, and 2c respectively have reflectances of 25% 

5 (1/4), 33% (1/3), and 50% (1/2), and supply beams L1 , 
L2, L3, and L4 having equal light amounts to image 
formation planes (focal planes) 3a, 3b, 3c, and 3d of 
the four object images, thus forming object images 
having the same size and the same brightness on the 

10 image formation planes 3a, 3b, 3c, and 3d. The image 
pickup device also includes image pickup element 
chips 4a, 4b, 4c, and 4d each having a plurality of 
light-receiving portions, which are split on a plane. 
These light-receiving portions are arranged at non- 

15 neighboring positions when an object image is split 
into a plurality of images on each of the image forma- 
tion planes 3a, 3b, 3c, and 3d. The image pickup de- 
vice further includes an image synthesizing circuit 5 
for receiving image information from the image pickup 

20 element chips 4a, 4b, 4c, and 4d, and synthesizing the 
entire object image. 

On each of the image formation planes 3a, 3b, 3c, 
and 3d, an object image is split into 16 (4 x 4 in the 
horizontal and vertical directions) portions, as shown 

25 in Figs. 52 A to 52D, and the plurality of light-receiving 
portions A1 to A4, B1 to B4, C1 to C4, or D1 to D4 of 
a corresponding one of the image pickup element 
chips 4a, 4b, 4c, and 4d are arranged at four non- 
neighboring split positions. More specifically, on the 

30 image formation plane 3a shown in Fig. 52A, the light- 
receiving portions A1 , A2, A3, and A4 are respectively 
arranged at the first, third, ninth, and eleventh posi- 
tions. On the image formation plane 3b shown in Fig. 
52B, the light-receiving portions B1, B2, B3, and B4 

35 are respectively arranged at the second, fourth, tenth, 
and twelfth positions. On the image formation plane 
3c shown in Fig. 52C, the light-receiving portions C1, 
C2, C3, and C4 are respectively arranged at the fifth, 
seventh, thirteenth, and fifteenth positions. On the 

40 image formation plane 3d shown in Fig. 52 D, the light- 
receiving portions D1 , D2, D3, and D4 are respective- 
ly arranged at the sixth, eighth, fourteenth, and six- 
teenth positions. 

Image information of an object, which is sepa- 

45 rately picked up by the 16 light-receiving portions A1 
to A4, B1 to B4, C1 to C4, and D1 to D4 in the above- 
mentioned arrangement states of the image pickup 
element chips 4a, 4b, 4c f and 4d on the image forma- 
tion planes 3a, 3b, 3c, and 3d, is synthesized by the 

so image synthesizing circuit 5, as described above. Fig. 
53 shows the state of the synthesized image informa- 
tion, and illustrates contributions of the respective 
light-receiving portions (A, B, C, and D) to the object 
image. In this embodiment, the number of effective 

55 pixels on the image formation planes 3a, 3b, 3c, and 
3d is 16 times that of a single image pickup element, 
and a resolution equivalent to that obtained when an 
image pickup element having the number of pixels 16 
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times that of a conventional image pickup element, 
can be obtained, thus obtaining an image with high im- 
age quality. 

Upon realization of the arrangements shown in 
Figs. 52A to 52D, when the packages of the image 5 
pickup elements are sufficiently small, the 16 light- 
receiving portions A1 to A4, B1 to B4, C1 to C4, and 
D1 to D4 can be constituted by independent image 
pickup elements. However, when the size of the pack- 
age of the image pickup element is too large, if the in- 10 
dependent image pickup elements are used, they in- 
terfere with each other. Thus, in this embodiment, the 
image pickup element chip 4a whose light-receiving 
portion has a size corresponding to nine out of 16 split 
portions is arranged on the image formation plane 3a, 15 
as indicated by a solid line in Fig. 54A, and the light- 
receiving portions A1 to A4 are set on the four hatched 
portions of the these split portions. The image pickup 
element chip 4b whose light-receiving portion has a 
size corresponding to nine out of 16 split portions is 20 
arranged on the image formation plane 3b, as indicat- 
ed by a solid line in Fig. 54B, and the light-receiving 
portions B1 to B4 are set on the four hatched portions 
of the these split portions. Similarly, the image pickup 
element chip 4c whose light-receiving portion has a 25 
size corresponding to nine out of 16 split portions is 
arranged on the image formation plane 3c, as indicat- 
ed by a solid line in Fig. 54C f and the light-receiving 
portions C1 to C4 are set on the four hatched portions 
of the these split portions. The image pickup element 30 
chip 4d whose light-receiving portion has a size cor- 
responding to nine out of 16 split portions is arranged 
on the image formation plane 3d, as indicated by a 
solid line in Fig. 54D, and the light-receiving portions 
D1 to D4 are set on the four hatched portions of the 35 
these split portions. 

In this case, the size of each of the light-receiving 
portions A1 to A4. B1 to B4, C1 to C4, and D1 to D4 
is set to be equal to the image size (e.g., a 1/2" cor- 
respondence size) of a currently popular image pick- 40 
up element. In this manner, the manufacturing equip- 
ment (including photomasks and the like) of the cur- 
rently popular image pickup element can be used 
without modifications, and the image pickup element 
chips 4a to 4d shown in Figs. 54A to 54D can be man- 45 
ufactured with a high yield (since the manufacturing 
processes and the like are stable). 

Furthermore, since the alignment precision in a 
manufacturing apparatus of the image pickup element 
chip is very high, the relative positions of the light- so 
receiving positions of the light-receiving portions A1 
to A4, B1 to B4, C1 to C4, and D1 to D4 can be set 
with very high precision. Therefore, as an alignment 
operation of the light-receiving portions (including a 
falling direction), the alignment operations among the ss 
light-receiving portions A1 to A4, B1 to B4, C1 to C4, 
and D1 to D4 need not be performed, and the posi- 
tions of the image pickup element chips 4a to 4d need 



only be adjusted. This is very preferable in terms of 
stability of light-receiving positional precision includ- 
ing an environmental change and a change over time. 

Fig. 55 is a plan view showing the structure of a 
single image pickup element chip. The structure 
shown in Fig. 55 includes a semiconductor chip 10 of 
an image pickup element, an effective light-receiving 
area (light-receiving portion) 11 provided to a hatched 
portion inside the semiconductor chip 10, and a plur- 
ality of bonding pads 12 and 13 connected to external 
pins through wires. These bonding pads 12 and 13 
are connected to a circuit on the semiconductor chip 
1 0 through necessary wires during the manufacturing 
process of an integrated circuit (image pickup ele- 
ment). As shown in Fig. 55, bonding wires extending 
from the semiconductor chip 10 of the image pickup 
element to external terminals are led from the ends of 
the semiconductor chip 10. With this structure, the 
distance between the bonding pads 12 and 13 on the 
semiconductor chip 10 and a lead frame of an image 
pickup element package can be minimized. For this 
reason, easy machining is allowed, and electrical in- 
terference among bonding wires does not easily oc- 
cur, thus improving stability and reliability. 

For the sake of simplicity, assume that the bond- 
ing pads 12 are terminals for signals such as driver in- 
puts to be input to the image pickup element, the 
bonding pads 13 are terminals for signals such as 
photoelectric conversion outputs to be output from the 
image pickup element, and other terminals such as a 
power supply terminal, a ground terminal and the like 
are property connected to either side. In this case, 
when each of the image pickup element chips 4a to 
4d shown in Figs. 54 A to 54D is constituted on the ba- 
sis of the image pickup element shown in Fig. 55, the 
arrangement state of the light-receiving portions of 
each image pickup element chip is as shown in Fig. 
56. 

In Fig. 56, a semiconductor chip 100 corresponds 
to one of the image pickup element chips 4a to 4d 
shown in Figs. 54A to 54D, and includes light- 
receiving portions 111 to 114 corresponding to those 
of each of the image pickup element chips 4a to 4d 
shown in Figs. 54Ato 54D. As can be seen from Fig. 
55, the bonding pads of these light-receiving portions 
111 to 114 are pads 121 to 124 (corresponding to the 
pads 12 in Fig. 55) in Fig. 56 and pads 131 to 134 (cor- 
responding to the pads 13 in Fig. 55). 

As can be apparent from Fig. 56, a wide blank re- 
gion (a portion which is not used on the chip) is pres- 
ent among the light-receiving portions 111 to 114, and 
is wasteful in terms of the space factor. Thus, in this 
embodiment, a peripheral circuit portion of the image 
pickup element is formed between the light-receiving 
portions. 

Fig. 57 is a diagram showing an arrangement 
wherein an input/output circuit is arranged in a blank 
portion between the light-receiving portions. Fig. 57 
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is basically the same as Fig. 56, and the same refer- 
ence numerals in Fig. 57 denote the same parts as in 
Fig. 56. Most of a portion of the semiconductor chip 
100 has no circuit elements excluding the light- 
receiving portions 111 to 114, and is in a blank state. 
Thus, as indicated by double lines in Fig. 57, by util- 
izing the blank portion between the light-receiving 
portions, the input bonding pads 121 to 124 are con- 
nected to bonding pads 141 to 144 arranged on the 
side edges of the chip through input circuits (not 
shown) or drivers (driving circuits) 161 to 164 formed 
on the blank region. The output bonding pads 131 to 
134 are connected to bonding pads 151 to 154 ar- 
ranged at the side edges of the chip through output 
circuits [noise reduction circuits for reducing noise 
components of output signals, S/H circuits for sam- 
pling/holding signals, or output-side signal processing 
circuits (a (variable gain) amplifier, a clamp circuit, a 
gamma correction circuit, a black/white clip circuit, 
and the like, or an A/D converter)] 171 to 1 74. 

For the sake of illustrative convenience, Fig. 57 il- 
lustrates the drivers 161 and 163, and the output cir- 
cuits 172 and 174 such that they are not present on 
the blank region between the light-receiving portions. 
However, in practice, these circuits are formed on the 
blank region between the light-receiving portions. The 
above-mentioned output circuits 171 to 174 may in- 
clude a storage portion of a frame transfer type CCD, 
a frame interline type CCD, or the like. 

Fig. 58 shows a modification of Fig. 57, and ex- 
emplifies a case wherein the input side is multiplexed. 
The two arrangements are almost the same, and the 
same reference numerals in Fig. 58 denote the same 
parts as in Fig. 57. An only difference is that the driv- 
ers 161 to 164 are controlled through the single bond- 
ing pad 141 of the chip. This is because the input im- 
pedance of the drivers is high, and the drivers can be 
sufficiently driven by a single timing signal generator. 
When the output impedance of the timing signal gen- 
erator is relatively high, and the generator cannot 
drive four drivers, the output of the timing signal gen- 
erator may be connected to a buffer to drive the four 
drivers. In this case, the buffer can be arranged in the 
semiconductor chip 100. On the contrary, when a plur- 
ality of light-receiving portions can be driven by a sin- 
gle driver, the plurality of light-receiving portions can 
be driven by a single driver. 

In Fig. 58, the light-receiving portions are simul- 
taneously driven. When the light-receiving portions 
are to be sequentially driven in terms of output-side 
signal processing, the arrangement shown in Fig. 55 
can be employed. When the light-receiving portions 
are to be synchronously driven, the arrangement 
shown in Fig. 58 is simplest, and precision can also 
be improved. Furthermore, in this modification, the 
number of pins of the semiconductor chip 1 00 can be 
greatly decreased, thus providing another merit. 

Fig. 59 shows another modification of Fig. 57, and 



exemplifies a case wherein the output side is multi- 
plexed. Also in this case, the two arrangements are al- 
most the same, and the same reference numerals in 
Fig. 59 denote the same parts as in Fig. 57. Only a dif- 

5 ference from Fig. 58 will be described below. In Fig. 
59, all the output circuits 171 to 1 74 are connected to 
a multiplexer 180, and their outputs are output from 
the single bonding pad 1 51 on the chip. The multiplex- 
er 180 determines one of the light-receiving portions 

w 111 to 114 to output information according to a control 
signal from a bonding pad 190 arranged at the side 
edge of the semiconductor chip 100. This arrange- 
ment is suitable for a case wherein photographing re- 
sults are output from the light-receiving portions in a 

15 frame-sequential (time-serial) manner in, e.g., a still 
image photographing operation. In this case, the num- 
ber of pins of the semiconductor chip 100 can also be 
greatly decreased. 

Fig. 60 shows a modification of the semiconduc- 

20 tor chip shown in Fig. 59, and exemplifies a case 
wherein the multiplexer 1 80 is arranged at the output 
side of an output circuit 1 70. More specifically, the two 
arrangements are almost the same, and the same ref- 
erence numerals in Fig. 60 denote the same parts as 

25 in Fig. 59. Thus, only a difference from Fig. 58 will be 
described below. In Fig. 60, all the output bonding 
pads 1 31 to 1 34 are connected to the multiplexer 180, 
and their outputs are output from the single bonding 
pad 151 on the chip through the output circuit 170. 

30 The multiplexer 180 determines one of the light- 
receiving portions 111 to 114 to output information ac- 
cording to a control signal from a bonding pad 190 ar- 
ranged at the side edge of the semiconductor chip 
100. This arrangement is suitable for a case wherein 

35 photographing results are output from the light- 
receiving portions in a frame-sequential (time-serial) 
manner in, e.g., a still image photographing operation. 

In this case, the number of pins of the semicon- 
ductor chip 100 can also be greatly decreased. Fur- 

40 thermore, in this case, since the output circuit 170 is 
common to all the light-receiving portions 111 to 114, 
the light-receiving portions 111 to 114 can have good 
matching output characteristics. In this case, the out- 
put circuit 1 70 may include a storage portion common 

45 to light- receiving portions when frame transfer type 
CCDs, frame interline type CCDs, or the like are em- 
ployed. 

Fig. 61 is a block diagram showing a circuit ar- 
rangement of the image pickup device having the ar- 

50 rangement shown in Fig. 51. In Fig. 61, the image 
pickup device includes an image pickup element 
(e.g., a CCD) 2001 for photoelectricaliy converting an 
optical image of an object. The image pickup element 
2001 corresponds to the light-receiving portion A1 in 

55 Fig. 54A in practice, and may include a storage por- 
tion when a frame transfer type CCD or a frame inter- 
line type CCD is employed. The image pickup device 
also includes a driver 2101 for driving the image pick- 
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up element 2001, a noise reduction circuit 2801 such 
as a correlation double sampling (CDS) circuit, a n S/H 
circuit 2201 for sampling/holding an output from the 
image pickup element 2001 , an A/D converter 2301 
for converting an analog output signal from the image s 
pickup element 2001, which is sampled and held by 
the S/H circuit 2201 , into a digital signal, and an image 
memory 2401 for storing digital object image informa- 
tion converted by the A/D converter 2301 from the im- 
age pickup element 2001. The operation timings of 10 
the driver 2101 to the image memory 2401 are con- 
trolled by a timing signal from a clock generation cir- 
cuit 205 as the above-mentioned timing signal gener- 
ator. 

Note that the above-mentioned signal processing 15 
circuits (a (variable gain) amplifier, a clamp circuit, a 
gamma correction circuit, a white/black clip circuit, 
and the like) may be arranged between the S/H circuit 
2201 and the A/D converter 2301. 

Some or all of the noise reduction circuit 2801 to 20 
the A/D converter 2301 may be arranged on the sem- 
iconductor chip 100 shown in Figs. 57 to 59. 

A portion consisting of the image pickup element 
2001 to the image memory 2401 and surrounded by 
a broken line constitutes an image pickup unit X1 . Im- 25 
age pickup units X2, X3 X16 having the same ar- 
rangement as that of the image pickup unit X1 attain 
a series of functions from a photoelectric conversion 
function of an object image by image pickup elements 
using the light-receiving portions A2 to A4, B1 to B4, 30 
C1 to C4, and D1 to D4 shown in Figs. 54A to 54D to 
a storage function by image memories. More specifi- 
cally, the image pickup units X2 to X16 respectively 
comprise image pickup elements 2002 to 2016, driv- 
ers 2202 to 2216, A/D converters 2302 to 2316, and 35 
image memories 2402 to 2416. The operation timings 
of the image pickup units X2 to X1 6 are also controlled 
by the clock generation circuit 205. 

In the circuit shown in Fig. 61, 16 pieces of infor- 
mation of 16-split object image portions are respec- 40 
tively stored in the image memories 2401 to 2416. 
These pieces of information are read out by an image 
synthesizing circuit 5, and are synthesized in a pat- 
tern shown in Fig. 53. Thereafter, the synthesized in- 
formation is output to an output terminal 6. The oper- 45 
ation timing of the image synthesizing circuit 5 at this 
time is also controlled by the clock generation circuit 
205. 

The above-mentioned image memories 2401 to 
2416 and the image synthesizing circuit 5 can be easi- 
ly realized using known memories and their control 
techniques. Therefore, a detailed description thereof 
will be omitted. 

In the above embodiment, when the light- 
receiving portions A, B, C, and D are arranged in the 
horizontal direction in units of four image pickup ele- 
ments shown in Fig. 62, the number of effective pixels 
of the image pickup elements can be infinitely in- 



creased, and the resolution can be theoretically infi- 
nitely improved. For example, Figs. 63Ato 63D exem- 
plify a case wherein the image pickup device is con- 
stituted by 64 image pickup elements, and Fig. 64 
shows synthesized image information from these im- 
age pickup elements. In this case, as described 
above, when the light-receiving portions are set, as 
shown in Figs. 65A to 65D, most area of each semi- 
conductor chip portion becomes a blank region. 
Therefore, a peripheral circuit portion is formed by 
utilizing the blank portion of the semiconductor chip 
by the same method as in Figs. 57 to 59, thereby im- 
proving the space factor of the semiconductor chip. In 
addition, the number of connection lines of the semi- 
conductor chip can be decreased, and anti-noise 
characteristics can be improved. 

In this manner, when an image formation optical 
path used in, e.g., an existing industrial-use multi-bo- 
ard camera is split into a plurality of paths by beam 
splitters, the equivalent number of pixels can be great- 
ly increased, and an image having higher image qual- 
ity can be obtained. Furthermore, since each image 
formation plane can be formed by a single image pick- 
up element chip in which light-receiving elements 
each having a size equal to that of a consumer-use 
image pickup element, which is technically sufficient- 
ly established, are arranged at non-neighboring pos- 
itions, a manufacturing apparatus (including photo- 
masks) and manufacturing processes of the consum- 
er-use image pickup element can be commonly used. 
In addition, an image pickup element having high per- 
formance in view of the relative positional precision of 
the light-receiving portions, flatness, and the like can 
be manufactured with a high yield. Since a single im- 
age pickup element chip (with a plurality of light- 
receiving portions) is arranged on each image forma- 
tion plane, the image pickup element chip (light- 
receiving portions) can be aligned with considerably 
higher precision and stability than those in a case 
wherein the light-receiving portions are constituted by 
independent image pickup element chips. 

Furthermore, since all the bonding pads are ar- 
ranged at the side edges of the semiconductor chip, 
an arrangement having good machinability and reli- 
ability can be provided. In addition, when a peripheral 
circuit portion such as an input/output circuit is formed 
on a blank portion between the light-receiving por- 
tions on the semiconductor chip, the chip space can 
be efficiently utilized. In particular, a weak output sig- 
nal can be prevented from being transmitted along a 
long wire, and anti-noise characteristics can be im- 
proved. 

The operation frequency of the device of the pres- 
ent invention can be as low as that used in an existing 
home video camera, and a high frequency required in 
a "hi-vision" camera is not necessary. Thus, the de- 
vice of the present invention can be easily realized by 
circuit members and techniques used in conventional 
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devices. 

As described above, according to the present in- 
vention, image pickup light from an object is split into 
a plurality of beams in equal light amounts, and object 
images are formed at different positions. A plurality of 
split light-receiving portions of image pickup element 
chips are arranged at non-neighboring split positions 
when an object image is split into a plurality of images 
on each image formation surface, and pieces of im- 
age information from the image pickup element chips 
are synthesized later. In addition, a peripheral circuit 
portion of the image pickup element is arranged be- 
tween the plurality of split light-receiving portions. 
Therefore, the number of effective pixels can be in- 
creased using a normal image pickup element without 
using a high-integration image pickup element and 
image quality can be improved. In addition, the space 
factor of the image pickup element chip can be im- 
proved, and anti-noise characteristics can also be im- 
proved. 

Fig. 66 is a diagram showing principal part of an 
image pickup device according to the tenth embodi- 
ment of the present invention. The image pickup de- 
vice shown in Fig. 66 includes an imaging lens 1 
through which image pickup light L from an object 
passes, and beam splitters 2a, 2b, and 2c serving as 
split means for splitting the image pickup light L into 
a plurality of beams L1, L2, L3, and L4 in equal light 
amounts, and forming object images at different pos- 
itions. Each of these beam splitters 2a, 2b, and 2c 
comprises, e.g., a half mirror. The beam splitters 2a, 
2b, and 2c respectively have reflectances of 25% 
(1/4), 33% (1/3), and 50% (1/2), and supply beams L1. 
L2, L3, and L4 having equal light amounts to image 
formation planes (focal planes) 3a, 3b, 3c, and 3d of 
the four object images, thus forming object images 
having the same size and the same brightness on the 
image formation planes 3a, 3b, 3c, and 3d. The image 
pickup device also includes image pickup element 
chips 4a, 4b, 4c, and 4d each having a plurality of 
light-receiving portions, which are split on a plane. 
These light-receiving portions are arranged at non- 
neighboring positions when an object image is split 
into a plurality of images on each of the image forma- 
tion planes 3a, 3b, 3c, and 3d. The image pickup de- 
vice further includes an image synthesizing circuit 5 
for receiving image information from the image pickup 
element chips 4a, 4b, 4c, and 4d, and synthesizing the 
entire object image. 

On each of the image formation planes 3a, 3b, 3c, 
and 3d, an object image is split into 16 (4 x 4 in the 
horizontal and vertical directions) portions, as shown 
in Figs. 67A to 67D, and the plurality of light-receiving 
portions A1 to A4, B1 to B4, C1 to C4, or D1 to D4 of 
a corresponding one of the image pickup element 
chips 4a, 4b, 4c, and 4d are arranged at four non- 
neighboring split positions. More specifically, on the 
image formation plane 3a shown in Fig. 67A, the light- 



receiving portions A1 , A2, A3, and A4 are respectively 
arranged at the first, third, ninth, and eleventh posi- 
tions. On the image formation plane 3b shown in Fig. 
67B, the light-receiving portions B1, B2, B3, and B4 
5 are respectively arranged at the second, fourth, tenth, 
and twelfth positions. On the image formation plane 
3c shown in Fig. 67C, the light-receiving portions C1 , 
C2, C3, and C4 are respectively arranged at the fifth, 
seventh, thirteenth, and fifteenth positions. On the 

10 image formation plane 3d shown in Fig. 67D, the light- 
receiving portions D1 , D2, D3, and D4 are respective- 
ly arranged at the sixth, eighth, fourteenth, and six- 
teenth positions. 

Image information of an object, which is sepa- 

15 rately picked up by the 16 light-receiving portions A1 
to A4, B1 to B4, C1 to C4, and D1 to D4 in the above- 
mentioned arrangement states of the image pickup 
element chips 4a, 4b, 4c, and 4d on the image forma- 
tion planes 3a, 3b, 3c, and 3d, is synthesized by the 

20 image synthesizing circuit 5, as described above. Fig. 
68 shows the state of the synthesized image informa- 
tion, and illustrates contributions of the respective 
light-receiving portions (A, B, C, and D) to the object 
image. In this embodiment, the number of effective 

25 pixels on the image formation planes 3a, 3b, 3c, and 
3d is 16 times that of a single image pickup element, 
and a resolution equivalent to that obtained when an 
image pickup element having the number of pixels 16 
times that of a conventional image pickup element, 

30 can be obtained, thus obtaining an image with high 
image quality. 

Upon realization of the arrangements shown in 
Figs. 67A to 67D, when the packages of the image 
pickup elements are sufficiently small, the 16 light- 

35 receiving portions A1 to A4, B1 to B4, C1 to C4, and 
D1 to D4 can be constituted by independent image 
pickup elements. However, when the size of the pack- 
age of the image pickup element is too large, if the in- 
dependent image pickup elements are used, they in- 

40 terfere with each other. Thus, in this embodiment, the 
image pickup element chip 4a whose light-receiving 
portion has a size corresponding to nine out of 1 6 split 
portions is arranged on the image formation plane 3a, 
as indicated by a solid line in Fig. 69A, and the light- 

45 receiving portions A1 to A4 are set on the four hatched 
portions of the these split portions. The image pickup 
element chip 4b whose light-receiving portion has a 
size corresponding to nine out of 16 split portions is 
arranged on the image formation plane 3b, as indicat- 

so ed by a solid line in Fig. 69B, and the light-receiving 
portions B1 to B4 are set on the four hatched portions 
of the these split portions. Similarly, the image pickup 
element chip 4c whose light-receiving portion has a 
size corresponding to nine out of 16 split portions is 

55 arranged on the image formation plane 3c, as indicat- 
ed by a solid line in Fig. 69C, and the light-receiving 
portions C1 to C4 are set on the four hatched portions 
of the these split portions. The image pickup element 
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chip 4d whose light-receiving portion has a size cor- 
responding to nine out of 16 split portions is arranged 
on the image formation plane 3d, as indicated by a 
solid line in Fig. 69D, and the light-receiving portions 
D1 to D4 are set on the four hatched portions of the 
these split portions. 

In this case, the size of each of the light-receiving 
portions A1 to A4, B1 to B4, C1 to C4, and D1 to D4 
is set to be equal to the image size (e.g., a 1/2* cor- 
respondence size) of a currently popular image pick- 
up element. In this manner, the manufacturing equip- 
ment (including photomasks and the like) of the cur- 
rently popular image pickup element can be used 
without modifications, and the image pickup element 
chips 4a to 4d shown in Figs. 69Ato 69D can be man- 
ufactured with a high yield (since the manufacturing 
processes and the like are stable). 

Furthermore, since the alignment precision in a 
manufacturing apparatus of the image pickup element 
chip is very high, the relative positions of the light- 
receiving positions of the light-receiving portions A1 
to A4, B1 to B4, C1 to C4, and D1 to D4 can be set 
with very high precision. Therefore, as an alignment 
operation of the light-receiving portions (including a 
falling direction), the alignment operations among the 
light-receiving portions A1 to A4, B1 to B4, C1 to C4 ( 
and D1 to D4 need not be performed, and the posi- 
tions of the image pickup element chips 4a to4d need 
only be adjusted. This is very preferable in terms of 
stability of light-receiving positional precision includ- 
ing an environmental change and a change overtime. 

In this embodiment, when each of the image pick- 
up element chips 4a to 4d shown in Figs. 69Ato 69D 
is constituted on the basis of the image pickup ele- 
ment shown in Fig. 55, the arrangement state of the 
light-receiving portions of each image pickup element 
chip is as shown in Fig. 70. More specifically, in Fig. 
70, a semiconductor chip 100 corresponds to each of 
the image pickup element chips 4a to 4d shown in 
Figs. 69A to 69D, and light-receiving portions 111 to 
114 correspond to those of the image pickup element 
chips 4a to 4d. As can be seen from Fig. 55, bonding 
pads of these light-receiving portions 111 to 114 are 
located at positions of spaces 121 to 128 shown in 
Fig. 70. 

The bonding pad spaces 122, 123, 126, and 127 
of the light-receiving portions 111 to 114 are located 
not near the side edges of the semiconductor chip 100 
but at inner deep positions. Therefore, when bonding 
wires are connected from these positions to a lead 
frame of an IC package, the bonding wires become 
very long, resulting in poor machinability and reliabil- 
ity. 

Thus, in this embodiment, in order to eliminate 
this drawback, a wiring pattern to be connected to 
bonding pads arranged at the side edges of the sem- 
iconductor chip 100 is formed between the split light- 
receiving portions, as shown in Fig. 71. Fig. 71 is sub- 



stantially the same as Fig. 70, and the same reference 
numerals in Fig. 71 denote the same parts as in Fig. 
70. Therefore, only a difference from Fig. 70 will be 
described below. Most portion of the semiconductor 

5 chip 100 has no circuit elements excluding the light- 
receiving portions 111 to 114, and is in a blank state. 
Thus, as indicated by double lines in Fig. 71, when a 
wiring pattern for respectively connecting the space 
122 and a bonding pad 131, the space 123 and a 

10 bonding pad 132, the space 126 and a bonding pad 
133, and the space 127 and a bonding pad 134 is 
formed by utilizing the blank portion between the 
light-receiving portions, all the bonding pads includ- 
ing the bonding pads 1 31 to 1 34 can be located at the 

15 side edge portions of the semiconductor chip 100. For 
this reason, the bonding pads at these positions and 
the lead frame of the IC package can be connected 
through the shortest bonding wires. Therefore, easy 
bonding is allowed, and anti-noise characteristics can 

20 be improved, thus improving machinability and reli- 
ability. 

Fig. 72 is a block diagram showing a circuit ar- 
rangement of the image pickup device having the ar- 
rangement shown in Fig. 66. In Fig. 72, the image 

25 pickup device includes an image pickup element 
(e.g., a CCD) 2001 for photoelectrical^ converting an 
optical image of an object. The image pickup element 
2001 corresponds to the light-receiving portion A1 in 
Fig. 69A in practice. The image pickup device also in- 

30 eludes a driver 2101 for driving the image pickup ele- 
ment 2001, an S/H circuit 2201 for sampling/holding 
an output from the image pickup element 2001, an 
A/D converter 2301 for converting an analog output 
signal from the image pickup element 2001, which is 

35 sampled and held by the S/H circuit 2201 , into a digital 
signal, and an image memory 2401 for storing digital 
object image information converted by the A/D con- 
verter 2301 from the image pickup element 2001 . The 
operation timings of the driver 2101 to the image 

40 memory 2401 are controlled by a timing signal from a 
clock generation circuit 205 as the above-mentioned 
timing signal generator. 

A portion consisting of the image pickup element 
2001 to the image memory 2401 and surrounded by 

45 a broken I ine constitutes an image pickup unit X1 . Im- 
age pickup units X2, X3 X16 having the same ar- 
rangement as that of the image pickup unit X1 attain 
a series of functions from a photoelectric conversion 
function of an object image by image pickup elements 

so using the light-receiving portions A2 to A4, B1 to B4, 
C1 to C4, and D1 to D4 shown in Figs. 69Ato 69D to 
a storage function by image memories. More specifi- 
cally, the image pickup units X2 to X16 respectively 
comprise image pickup elements 2002 to 2016, driv- 

55 ers 2202 to 2216, A/D converters 2302 to 2316, and 
image memories 2402 to 241 6. The operation timings 
of the image pickup units X2 to X1 6 are also controlled 
by the clock generation circuit 205. 
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In the circuit shown in Fig. 72, 16 pieces of infor- 
mation of 16 -split object image portions are respec- 
tively stored in the image memories 2401 to 2416. 
These pieces of information are read out by the image 
synthesizing circuit 5, and are synthesized in a pat- s 
tern shown in Fig. 69. Thereafter, the synthesized in- 
formation is output to an output terminal 6. The oper- 
ation timing of the image synthesizing circuit 5 at this 
time is also controlled by the clock generation circuit 
205. 10 

The above-mentioned image memories 2401 to 
241 6 and the image synthesizing circuit 5 can be easi- 
ly realized using known memories and their control 
techniques. Therefore, a detailed description thereof 
will be omitted. 15 

In the above embodiment, when the light- 
receiving portions A, B, C, and D are arranged in the 
horizontal direction in units of four image pickup ele- 
ments shown in Fig. 73, the number of effective pixels 
of the image pickup elements can be infinitely in- 20 
creased, and the resolution can be theoretically infi- 
nitely improved. For example, Figs. 74 A to 74D exem- 
plify a case wherein the image pickup device is con- 
stituted by 64 image pickup elements, and Fig. 75 
shows synthesized image information from these im- 25 
age pickup elements. In this example, most of wires 
led from the light- receiving portions of hatched por- 
tions in Figs. 76A to 76D are not present at the side 
edges of the semiconductor chip. In contrast to this, 
when a wiring pattern is formed by utilizing the blank 30 
portion of the semiconductor chip by the same meth- 
od as in Fig. 70, bonding pads can be arranged at the 
side edges of the semiconductor chip, as can be ap- 
parent from the above description. 

In this manner, when an image formation optical 35 
path used in, e.g., an existing industrial-use multi-bo- 
ard camera is split into a plurality of paths by a beam 
splitter, the equivalent number of pixels can be greatly 
increased, and an image having higher image quality 
can be obtained. For example, when an image pickup 40 
element having four hundred thousand pixels and 
used in an existing home video camera is adopted in 
the present invention, the number of pixels can reach 
1.6 millions in the embodiment shown in Fig. 66, and 
can reach 6.4 millions in this embodiment. When the 45 
image size is further increased, the number of effec- 
tive pixels can be infinitely increased. 

Furthermore, since each image formation plane 
can be formed by a single image pickup element chip 
in which light-receiving elements each having a size so 
equal to that of a consumer-use image pickup ele- 
ment, which is technically sufficiently established, are 
arranged at non-neighboring positions, a manufactur- 
ing apparatus (including photomasks) and manufac- 
turing processes of the consumer-use image pickup 55 
element can be commonly used. In addition, an image 
pickup element having high performance in view of 
the relative positional precision of the light-receiving 



portions, flatness, and the like can be manufactured 
with a high yield. Since a single image pickup element 
chip (with a plurality of light-receiving portions) is ar- 
ranged on each image formation plane, the image 
pickup element chip (light-receiving portions) can be 
aligned with remarkably higher precision and stability 
than those in a case wherein the light-receiving por- 
tions are constituted by independent image pickup 
element chips. 

Furthermore, since all the bonding pads are lo- 
cated at the side edges of the semiconductor chip, 
good machinability and reliability can be provided. 

The operation frequency of the device of the pres- 
ent invention can be as low as that used in an existing 
home video camera, and a high frequency required in 
a "hi-vision" camera is not necessary. Thus, the de- 
vice of the present invention can be easily realized by 
circuit members and techniques used in conventional 
devices. 

As described above, according to this embodi- 
ment, image pickup light from an object is split into a 
plurality of beams in equal light amounts, and object 
images are formed at different positions. A plurality of 
split light-receiving portions of image pickup element 
chips are arranged at non- neighboring split positions 
when an object image is split into a plurality of images 
on each image formation surface, and pieces of inn- 
age information from the image pickup element chips 
are synthesized later. In addition, a wiring pattern 
connected to connection portions arranged at the 
side edges of the image pickup element chip is 
formed between the plurality of split light-receiving 
portions. Therefore, the number of effective pixels 
can be increased using a normal image pickup ele- 
ment without using a high-integration image pickup 
element, and image quality can be improved. In addi- 
tion, the space factor of the image pickup element 
chip can be improved, and anti-noise characteristics 
can also be improved. Moreover, easy bonding is al- 
lowed, thus improving machinability and reliability. 

In each of the above-mentioned embodiments, 
light is incident on a portion between the light- 
receiving portions. In this state, image light reflected 
by such a portion becomes stray light, thus causing 
an adverse influence such as flare. More specifically, 
since some light components of an object image are 
radiated on portions B1 and B2 in Fig. 77Aand on por- 
tions A1 and A2 in Fig. 77B, these portions may un- 
desirably become very bright Light reflected by these 
portions becomes stray light, and when some stray 
light components reach the light-receiving portions, 
they cause flare, thus deteriorating quality of the 
picked-up image. 

Thus, this embodiment comprises split means for 
splitting an optical path of an object image obtained 
by an image pickup optical system into a plurality of 
optical paths, a plurality of image pickup elements, ar- 
ranged at non-neighboring positions on image forma- 
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tion planes of the plurality of optical paths split by the 
split means, for picking up corresponding portions of 
the object image, synthesizing means for synthesiz- 
ing image pickup information of the entire object im- 
age on the basis of information from the plurality of im- 
age pickup elements, and non-reflection members ar- 
ranged on portions, where the image pickup elements 
are not arranged, of the image formation planes. 
Thus, even when light is radiated on the portions, 
where the image pickup elements are not arranged, 
of the image formation planes, since the light is not re- 
flected, stray light can be prevented, and a high- 
resolution picked-up image with high quality can be 
obtained. 

The content of the eleventh embodiment will be 
described in detail below with reference to the accom- 
panying drawings. 

The same optical system as in the previous em- 
bodiment (e.g., an optical system shown in Fig. 1) is 
used, and as focal planes 3 and 4, image pickup ele- 
ments shown in Figs. 78A and 78B are used. More 
specifically, Figs. 78A and 78B show states of the fo- 
cal planes (or image formation planes) 3 and 4 on 
which images split by a beam splitter 2 are formed. A 
and B respectively correspond to the focal planes 3 
and 4. On each focal plane, an object image is split 
into four portions. On the focal plane 3, light-receiving 
portions A1 and A2 of an image pickup element are ar- 
ranged at the non-neighboring first and third posi- 
tions. On the focal plane 3, light-receiving portions B1 
and B2 of an image pickup element are arranged at 
the non-neighboring second and fourth positions. In 
this state, pieces of object image information sepa- 
rately picked up by the four light-receiving portions 
A1, A2, B1 , and B2 are synthesized to a single image 
later. In this manner, a complete original image can be 
restored in a contribution pattern of the image pickup 
elements to an object image, as shown in Fig. 77C. 

An anti-reflection film is coated or adhered on 
hatched portions B1 and B2 in Fig. 78Aand hatched 
portions A1 and A2 in Fig. 78B. In this manner, even 
when object image light is radiated on the hatched 
portions, light reflected from these portions can be 
greatly suppressed, and quality deterioration of the 
picked-up image caused by reflected light can be pre- 
vented. In this embodiment, light is absorbed by the 
a nti- reflection film. However, the above-mentioned 
hatched portions may be constituted by transparent 
members to transmit light therethrough, as a matter of 
course. 

Fig. 79 shows the twelfth embodiment of the pres- 
ent invention. In this embodiment, the number of split 
optical paths is doubled, i.e., four as compared to the 
eleventh embodiment. 

In Fig. 79, an image pickup device includes a lens 
1, and beam splitters 2-1, 2-2, and 2-3 respectively 
having reflectances of about 25% (1/4), 33% (1/3), 
and 50% (1/2). These beam splitters 2-1 , 2-2, and 2- 



3 split incident light L into beams L1, L2, L3, and L4 
having equal light amounts, and form images at pos- 
itions of focal planes 3, 4, 5, and 6. In this embodi- 
ment, each focal plane (image formation plane) is split 
5 into 16 (= 4 x 4) portions, and four light-receiving por- 
tions are respectively arranged at four non-neighbor- 
ing positions on each focal plane, as shown in Figs. 
80Ato 80D: 

Focal plane 3: 
10 position 1 - light-receiving portion A1 

position 3 - light-receiving portion A2 
position 9 - light-receiving portion A3 
position 11 - light-receiving portion A4 
(Fig. 80A) 
is Focal plane 4: 

position 2 - light-receiving portion B1 
position 4 - light-receiving portion B2 
position 10 - light-receiving portion B3 
position 12 - light-receiving portion B4 
20 (Fig. 80B) 

Focal plane 5: 

position 5 - light-receiving portion C1 
position 7 - light-receiving portion C2 
position 13 - light-receiving portion C3 
25 position 15 - light-receiving portion C4 

(Fig. 80C) 
Focal plane 6: 

position 6 - light-receiving portion D1 
position 8 - light-receiving portion D2 
30 position 14 - light-receiving portion D3 

position 16 - light-receiving portion D4 
(Fig. 80D) 

In this state, object image information separately 
picked up by the 16 light-receiving portions A1 to A4, 

35 B1 to B4, C1 to C4, and D1 to D4 are synthesized to 
one image later. In this manner, a complete original 
image can be restored in a contribution pattern of the 
image pickup elements to an object image, as shown 
in Fig. 80E. In this case, the number of effective pixels 

40 on the focal planes can be 1 6 times that of a single im- 
age pickup element, and the resolution can be in- 
creased accordingly. 

Like in the eleventh embodiment, since object im- 
ages are formed on portions indicated by N in Figs. 

45 80A to 80D, an anti-reflection film is coated or ad- 
hered on these portions N. In this manner, light 
ref 1 ected by these portions N can be greatly reduced, 
and quality deterioration of the picked-up image 
caused by reflected light can be prevented. 

so Fig. 81 is a block diagram showing an electrical 

circuit of the eleventh embodiment of the present in- 
vention. In Fig. 81, the image pickup device includes 
an image pickup element (e.g., A1 in Fig. 78A) 100-1 
such as a CCD for photoelectrically converting an opt- 

55 ical image of an object, a driver 101-1 for driving the 
image pickup element 100-1 , a sample/hold (S/H) cir- 
cuit 102-1 for sampling and holding an output from the 
image pickup element 100-1, an A/D converter 103- 
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1 for converting an analog output signal from the im- 
age pickup element 1 00-1 , which is sampled and held 
by the S/H circuit 102-1, into a digital signal, and an 
image memory 104-1 for storing digital object image 
information from the image pickup element 100-1 
converted by the A/D converter 103-1 . The operation 
timings of the driver 101-1 to the image memory 104- 
1 are controlled by a clock circuit 105 for generating 
a timing signal. 

A portion consisting of the image pickup element 
100-1 to the image memory 104-1 and surrounded by 
a broken line constitutes an image pickup unit X1 . Im- 
age pickup units X2, X3, and X4 having the same ar- 
rangement as the image pickup unitXI attain a series 
of functions from a photoelectric conversion function 
of object images corresponding to B1 (Fig. 78B), A2 
(Fig. 78A), and B2 (Fig. 78B) by image pickup ele- 
ments to a storage function by image memories. The 
operation timings of the image pickup units X2, X3, 
and X4 are also controlled by the clock circuit 105. In 
this manner, four-split object image portions are re- 
spectively stored in the image memories 104-1 to 
104-4. An image synthesizing circuit 106 reads out 
and synthesizes these pieces of information in a pat- 
tern shown in Fig. 77C, and outputs the synthesized 
information to an output terminal 107. The operation 
timing of the image synthesizing circuit 106 is also 
controlled by the clock circuit 105. 

Since the image memories 104-1 to 104-4 and 
the image synthesizing circuit 106 can be easily real- 
ized by using a known memory technique and its con- 
trol technique, a detailed description thereof will be 
omitted. The electrical circuit of the twelfth embodi- 
ment can be realized by using 16 image pickup units 
and by synthesizing their outputs, and a detailed de- 
scription thereof will be omitted. 

In the eleventh embodiment, when light-receiving 
portions are repetitively arranged in units shown in 
Fig. 82, the resolution can be theoretically infinitely 
improved in one direction. Figs. 83Ato 83C exemplify 
a case wherein eight light-receiving portions are 
used. In this case, an anti-reflection film is coated or 
adhered to portions B in Fig. 83Aand portions A in Fig. 
83B, thus obtaining the same effect as described 
above. In the twelfth embodiment, when light- 
receiving portions are repetitively arranged in units 
shown in Fig. 84, the resolution can be theoretically in- 
finitely improved in both the vertical and horizontal di- 
rections. Figs. 85A to 85E exemplify a case wherein 
64 light-receiving portions are used. In this case, an 
a nti- reflection film is coated or adhered to portions N 
(which are not used for the light-receiving portions) in 
Figs. 85A to 85D, thereby obtaining the same effect 
as described above. 

As can be seen from the above description, ac- 
cording to the above embodiments, the number of ef- 
fective pixels of the image pickup elements can be 
greatly increased, and quality of the obtained image 



can be improved accordingly. Furthermore, deterior- 
ation of image quality caused by reflection of light by 
portions which are not used as light-receiving por- 
tions in the image pickup elements can be prevented. 

5 Fig. 86 is a block diagram showing a circuit ar- 

rangement of an image pickup device according to the 
thirteenth embodiment of the present invention. In 
Fig. 86, the image pickup device comprises a lens 1 
constituting an optical system for forming an object 

10 image, and an image pickup element (e.g., a CCD, a 
MOS, an image pickup tube, or the like) 2, on which 
an object image is formed, and which photoelectrical- 
ly converts image pickup light from an object, and out- 
puts image signals in units of pixels. The image pickup 

15 device also comprises a driver 3 for driving the image 
pickup element 2 at a timing controlled by a signal 
from a clock circuit 4, an S/H circuit 5 for sampling and 
holding image signals output from the image pickup 
element 2, an A/D converter 6 for converting sam- 

20 pled/held analog image signals into digital signals, a 
buffer memory 7 for storing the digital image signals 
and operation data (to be described later), and an op- 
eration circuit 8 for, when the output level of an image 
signal from the image pickup element 2 is equal to or 

25 lower than a predetermined value, determining a sig- 
nal obtained by adding and averaging the image sig- 
nals of neighboring pixels under the same condition 
as image signals of these pixels. The operation circuit 
8 receives image signals from the buffer memory 7, 

30 and the above-mentioned operation data. The image 
pickup device further comprises a recording circuit 9 
for recording the image signals output from the oper- 
ation circuit 8 on a recording medium 10. The opera- 
tion timings of the above-mentioned circuits are con- 

35 trolled by a signal from the clock circuit 4 like in the 
driver 3. 

In the image pickup device with the above ar- 
rangement, the image pickup element 2 outputs im- 
age signals in units of pixels. When the output level 

40 of an image signal is equal to or lower than a prede- 
termined value, the operation circuit 8 adds and aver- 
ages image signals of neighboring pixels under the 
same condition, and outputs the average signal as im- 
age signals of these pixels. Therefore, sufficient re- 

45 solving power can be assured for a bright portion of 
an object, and sufficient image signals can be ob- 
tained even for a dark portion of the object, thus ob- 
taining high image quality. 

In this case, the number of neighboring pixels 

so whose image signals are added is changed according 
to the output level of an image signal. The priority or- 
der is assigned to the neighboring pixels according to 
spatial relative positions, and a high priority is given 
for a pixel which has a small influence on resolving 

55 power. 

The details of the above-mentioned operation will 
be described below with reference to the flow chart 
shown in Fig. 87. 
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When a photographing operation is started, an 
object image is formed on the light-receiving portion 
of the image pickup element 2 through the lens 1 , and 
is exposed for a predetermined period of time (step 
1 01). Thereafter, the image pickup element 2 is driven 
by the driver 3 to output image signals for one frame. 
The image signals for one frame are stored in the buf- 
fer memory 7 through the S/H circuit 5 and the A/D 
converter 6 (step 102). 

Assuming that the numbers of pixels in the verti- 
cal and horizontal directions of the image pickup ele- 
ment 2 are respectively M and N f the object image in- 
formation stored in the buffer memory 7 is sequential- 
ly read out in units of pixels in I rows x J columns (I = 

1,2 M, J = 1 , 2 N), and after the readout pixels 

are subjected to operation processing, the processed 
pixels are recorded on the recording medium 10. 
When image information is to be read out, the coor- 
dinates (I, J) of the read address are initialized to (1 , 
1) (step 103), and thereafter, signals Sij of I rows x J 
columns pixels stored in the buffer memory 7 are read 
out (step 104). 

The operation circuit 8 then checks if the readout 
signal Sij is smaller than a first threshold value T1 in- 
put from the buffer memory 7 (step 1 05). At this time, 
if the signal Sij is equal to or larger than the threshold 
value T1, the object luminance of a pixel correspond- 
ing to the signal Sij is sufficiently high, and a sufficient 
signal can be obtained as an output for one pixel of the 
image pickup element 2. Thus, the operation circuit 8 
causes the recording circuit 9 to record image infor- 
mation of the pixel (I, J) of the image pickup element 
2 at a predetermined position on the recording me- 
dium 10 (step 106). 

However, if the readout signal Sij is smaller than 
the threshold value T1 , the object luminance corre- 
sponding to this pixel is low, and a sufficient signal 
cannot be obtained as an output for one pixel of the 
image pickup element 2 in terms of signal processing. 
In this case, it is checked if the signal Sij is smaller 
than a second threshold value T2 lower than the first 
threshold value T1 (step 107). At this time, if the signal 
Sij is equal to or larger than the threshold value T2, it 
is determined that a signal having a sufficient level for 
signal processing can be obtained by adding signals 
of two pixels under the same condition although the 
signal for one pixel is insufficient for processing. 
Thus, it is searched if there is a neighboring pixel un- 
der the same condition (step 1 08). In this case, for ex- 
ample, eight neighboring pixels (1+1, J-1), (1+1, J), 
(1+1, J+1). (I, J+1), (1-1. J+1), (1-1, J), (1-1, J-1). and 
(I, J-1) are searched, and it is checked if their signals 
Sij satisfy a condition T2 < Sij < T1. If there are no 
neighboring pixels satisfying the above condition, im- 
age information of the pixel (I, J) is recorded in step 
106 in the same manner as described above. How- 
ever, if neighboring pixels satisfying the above condi- 
tion are detected, a signal obtained by averaging a 



signal of the pixel of interest and a signal of one of the 
detected pixels is output as image signals of these 
pixels (step 109), and the flow then advances to step 
106. 

5 If a plurality of neighboring pixels under the same 

condition are detected in step 108, a pixel is selected 
in the order of a smaller influence on resolving power. 
For example, when this image pickup element 2 has 
a larger number of pixels in the vertical direction than 

10 that in the horizontal direction according to its aspect 
ratio, since the resolving power in the horizontal direc- 
tion tends to be short, a neighboring pixel is selected 
in the order of® oblique direction, © vertical direc- 
tion, and (D horizontal direction. 

15 If it is determined in step 107 that the readout sig- 

nal Sij is smaller than the second threshold value T2, 
it is determined that the object luminance correspond- 
ing to this pixel is still lower, a signal obtained by add- 
ing signals for two pixels is insufficient, and signals for 

20 four pixels must be added. Thus, it is checked if there 
are neighboring pixels under the same condition (step 
1 10). In this case, eight neighboring pixels are search- 
ed in the same manner as described above. When 
four or more neighboring pixels under the same con- 

25 drtion are found, the searching operation is stopped. 
However, when only three or less pixels are found, the 
searching operation of another eight neighboring pix- 
els using a neighboring pixel under the same condi- 
tion as a central pixel is repeated. However, if no pixel 

30 satisfying the same condition is found, the flow ad- 
vances to step 106. 

If neighboring pixels under the same condition 
are detected in step 110, it is checked if there are four 
or more pixels (step 111). If there are three or less pix- 

35 els, a signal obtained by adding and averaging these 
pixels is output (step 112), and the flow advances to 
step 106. If there are four or more pixels under the 
same condition, an average of four signals of these 
pixels is output as an image signal (step 113), and the 

40 flow advances to step 106. 

In this manner, when image information of the pix- 
el (I, J) is recorded on the recording medium 10 in step 
106, it is checked to prepare for the processing of the 
next pixel if the value of the column J has reached the 

45 last value N (J = N) (step 115). At this time, if NO in 
step 115, the value of the column J is incremented by 
one (step 116), and the operations in step 104 and 
subsequent steps are repeated. However, if YES in 
step 115 (J = N), it is checked if the value of the row 

so I is the last value M (I = M) (step 117). If NO in step 
1 1 7, the value of the row I is incremented by one (step 
118), and the operations in step 104 and subsequent 
steps are repeated. However, if YES in step 11 7 (i — 
M), the operation processing for all the pixels of the 

55 image pickup element 2 is completed, and the photo- 
graphing operation is ended. 

When an object is photographed by the image 
pickup element which has an increased number of 
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pixels, as described above, a portion, details of which 
must be clearly seen, in a scene is a relatively bright 
portion of an object, and a dark portion of the object 
need only provide rough information even though its 
details may not be clear. 

In this case, since a sufficient light amount per 
pixel is incident in a bright portion of a scene, a suf- 
ficiently high photoelectric conversion output can be 
obtained even when only one pixel is read out. How- 
ever, since a sufficient light amount per pixel is not in- 
cident in a dark portion of the scene, a sufficiently 
high photoelectric conversion output cannot be ob- 
tained when only one pixel is read out. However, a 
sufficiently high output can be obtained by adding 
photoelectric conversion outputs for a plurality of pix- 
els. As has been described above, information of de- 
tails is not always necessary for a dark portion, and 
color information can be rougher than the information 
of details for such a portion. Therefore, information 
lost by adding photoelectric conversion outputs for a 
plurality of pixels can rarely influence the overall ob- 
ject image in terms of visual sense characteristics of 
a person. 

This applies to an image pickup device using a 
currently available image pickup element, and a suf- 
ficiently high photoelectric conversion output can be 
obtained by adding color information of a plurality of 
pixels for a dark portion in a scene. 

In order to prevent a decrease in S/H in a dark 
portion of a scene, a relatively high standard signal 
level of an image pickup element is set. However, in 
an image pickup device obtained according to the 
present invention, the above-mentioned limitations 
can be relaxed. For this reason, the standard signal 
level of the image pickup element can be set to be low, 
and the dynamic range of the image pickup element 
can be widened accordingly. 

Fig. 88 is a block diagram showing a circuit ar- 
rangement according to the fourteenth embodiment 
of the present invention, which allows the above- 
mentioned color photographing operation. The same 
reference numerals in Fig. 88 denote the same parts 
as in Fig. 86. In Fig. 88, an optical system Afor forming 
an image of an object is constituted by a lens 1 and 
four beam splitters 11a, 11b, 11c, and 11 d comprising 
half mirrors. The beamsplitters 11a, 11b, 11c, and 11d 
split light L incident on the optical system A into light 
beams L1 to L4 having equal light amounts, and form 
object images having the same size and brightness. 
The object images are respectively formed on image 
pickup elements 2a, 2b, 2c, and 2d, such as CCDs, 
MOS elements, image pickup tubes, or the like. The 
image pickup elements 2a, 2b, 2c, and 2d photoeleo 
trically convert image pickup light from an object, and 
output image signals of respective color components 
in units of pixels. 

The image pickup element 2a has no filter since 
it is used for a luminance photographing operation. 



However, red, green, and blue color filters are respec- 
tively arranged in front of light-receiving portions of 
the image pickup elements 2b, 2c, and 2d, and the re- 
spective color components are photographed by the 

5 image pickup elements 2b, 2c, and 2d. More specifi- 
cally, the image pickup element 2b has the red filter 
since it is used for a red photographing operation, the 
image pickup element 2c has the green filter since it 
is used for a green photographing operation, and the 

10 image pickup element 2d has the blue filter since it is 
used for a blue photographing operation. In most of 
currently available multkboard type cameras, the im- 
age pickup element 2a for the luminance photograph- 
ing operation is omitted. In this embodiment, for the 

15 sake of simplicity, a four-board type arrangement will 
be exemplified. 

The circuit shown in Fig. 88 also includes a driver 
3 for driving the image pickup elements 2a, 2b, 2c, 
and 2d, a clock circuit 4 for out putting a signal for con- 

20 trolling the operation timings of the respective circuit 
portions, S/H circuits 5a, 5b, 5c, and 5d for respec- 
tively sampling/holding output signals from the image 
pickup elements 2a, 2b, 2c, and 2d, A/D converters 
6a, 6b, 6c, and 6d for converting the sampled/held 

25 signals into digital signals, buffer memories 7a, 7b, 
7c, and 7d for storing the digital signals and neces- 
sary operation data, an operation circuit 8 for, when 
the output level of an image signal from the image 
pickup elements 2a, 2b, 2c, and 2d is equal to or lower 

30 than a predetermined value, adding and averaging 
image signals of neighboring pixels under the same 
condition, and a recording circuit 9 for recording im- 
age information of an object on a recording medium 
1 0 on the basis of the output from the operation circuit 

35 8. 

The circuit shown in Fig. 88 independently proc- 
esses the object luminance, red image information, 
green image information, and blue image information 
although it is basically the same as the circuit shown 

40 in Fig. 86. When the operation circuit 8 detects a dark 
portion (low-luminance portion) of an object, it 
searches if there is a neighboring dark portion. If a 
neighboring dark portion is detected, the operation 
circuit 8 outputs a signal obtained by adding and aver- 

45 aging outputs of pixels corresponding to these dark 
portions. 

The operation of the circuit shown in Fig. 88 will 
be described below with reference to the flow chart 
shown in Fig. 87. An object image is formed on the 

so light-receiving portions of the image pickup elements 
2a, 2b, 2c, and 2d through the optical system A, and 
is exposed for a predetermined period of time (step 
1 01 ). Thereafter, the driver 3 causes the image pickup 
elements 2a, 2b, 2c, and 2d to output image signals 

55 for one frame. These image signals are respectively 
stored in the buffer memories 7a, 7b, 7c, and 7d 
through the S/H circuits 5a, 5b, 5c, and 5d, and the 
A/D converters 6a, 6b, 6c, and 6d (step 102). 
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Signals in units of pixels from the image pickup 
element 2a, i.e., signals of I rows x J columns (l= 1 , 

2,..., M, J = 1, 2 N) pixels are sequentially read out 

from the luminance buffer memory 7a, and the read- 
out signals are subjected to predetermined operation s 
processing, or if necessary, signals of corresponding 
pixels from the image pickup elements 2b, 2c, and 2d 
are read out from the buffer memories 7b, 7c, and 7d, 
and the readout signals are subjected to predeter- 
mined operation processing. Thereafter, the readout 10 
signals are recorded on the recording medium 10. In 
this case, coordinates (I, J) are initialized to (I = 1, J 
= 1) (step 103), and thereafter, signals Sij of I rows x 
J columns pixels of the image pickup elements are 
read out (step 104). 15 

The operation circuit 8 checks if the signal Sij of 
the readout pixel is smaller than a first threshold value 
T1 (Sij < T1 ) (step 1 05). If NO in step 1 05, three pieces 
of information of pixels (I, J) of the image pickup ele- 
ments 2b, 2c, and 2d are directly recorded on the re- 20 
cording medium 10 (step 106). However, if YES in 
step 105, it is checked if the signal Sij is smaller than 
a second threshold value T2 (Sij < T2; T2 < T1) (step 
107). If NO in step 107, the above-mentioned eight 
neighboring pixels are searched to check if there are 25 
neighboring pixels satisfying the same condition (T2 
< Sij < T1) (step 108). At this time, if there are no 
neighboring pixels satisfying the same condition, the 
flow advances to step 106 to directly record three 
pieces of information of pixels (I, J) of the image pick- 30 
up elements 2b, 2c, and 2d. However, if there are pix- 
els satisfying the same condition, signals of the cor- 
responding pixels from the buffer memories 7b, 7c, 
and 7d, and a signal of the detected neighboring pixel 
(one of a plurality of pixels if any) are averaged (step 35 
109), and the average signal is recorded on the re- 
cording medium 10 as image information in step 106. 
In this case, like in the above embodiment, if there are 
a plurality of neighboring pixels satisfying the same 
condition, a pixel is selected in the order of a smaller 40 
influence on resolving power. 

If it is determined in step 107 that the signal Sij is 
smaller than the second threshold value T2, it is 
checked if there are neighboring pixels satisfying the 
same condition (step 110). In this case, eight neigh- 45 
boring pixels are searched, and if four or more neigh- 
boring pixels satisfying the same condition are detect- 
ed, the searching operation is stopped. However, if 
only three or less pixels are detected, the searching 
operation of another eight neighboring pixels using a so 
neighboring pixel under the same condition as a cen- 
tral pixel is repeated. However, if no pixel satisfying 
the same condition is detected, the flow advances to 
step 106. If neighboring pixels satisfying the same 
condition are detected, it is checked if four or more 55 
pixels are detected (step 111). If NO in step 111, sig- 
nals of pixels, corresponding to the detected pixels, 
from the buffer memories 7b, 7c, and 7d are added 



and averaged (step 112), and the flow then advances 
to step 106. However, if four or more pixels are detect- 
ed, four signals of the detected pixels are averaged 
(step 113), and the flow advances to step 106. 

Upon completion of recording of image informa- 
tion of the pixel (I, J), like in the above embodiment, 
it is checked if the value of the column J is the last val- 
ue N (step 1 1 5). If NO in step 115, the value of the col- 
umn J is incremented by one (step 116), and the flow 
returns to step 104; otherwise, it is checked if the val- 
ue of the row I is the last value M (step 117). If NO in 
step 117, the value of the row I is incremented by one 
(step 118), and the flow returns to step 104; other- 
wise, this operation is ended. 

In this manner, pieces of image information of the 
image pickup elements 2b, 2c, and 2d in units of color 
components are recorded on the recording medium 
10. In this embodiment, satisfactory image informa- 
tion in units of colors can be obtained even for a dark 
portion as well as a bright portion of an object, and the 
same effect as in the above-mentioned embodiment 
can be obtained. 

As described above, according to this embodi- 
ment, when the level of a signal in units of pixels out- 
put from the image pickup element is equal to or lower 
than a predetermined value, signals of neighboring 
pixels satisfying the same condition are added and 
averaged, and the average signal is used as image 
signals of these pixels. For this reason, high image 
quality can be obtained even for a dark portion as well 
as a bright portion of an object. In addition, the stan- 
dard signal level of the image pickup element can be 
set to be low, and the dynamic range of the image 
pickup element can be widened accordingly. 



Claims 

1. An image pickup device comprising: 

split means (2) for splitting image pickup 
light from an object into a plurality of beams in 
equal tight amounts, and forming object images 
at different positions; 

a plurality of image pickup elements (101- 
104), light-receiving portions of which are ar- 
ranged at split positions which are not adjacent to 
each other when an object image is split into a 
plurality of image portions on each image forma- 
tion plane; and 

an image synthesizing circuit (3) for receiv- 
ing information from said image pickup elements, 
and synthesizing the object image. 

2. A device according to claim 1 , wherein said image 
pickup elements are controlled by a timing signal 
from a single clock generation circuit. 

3. An image pickup device comprising: 
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split means for splitting image pickup light 
from an object into a plurality of beams in equal 
light amounts, and forming object images at dif- 
ferent positions; 

a plurality of image pickup elements, light- 
receiving portions of which are arranged at split 
positions which are not adjacent to each other 
when an object image is split into a plurality of im- 
age portions on each image formation plane, so 
that each of the light-receiving portions partially 
overlaps the light-receiving portion at least at a 
neighboring split position of another image for- 
mation plane; 

an image synthesizing circuit for receiving 
information from said image pickup elements, 
and synthesizing the object image; and 

a correction circuit for comparing outputs 
from the overlap portions of said image pickup 
elements, and adjusting sensitivity levels of said 



a plurality of image pickup elements, light- 
receiving portions of which are arranged at split 
positions which are not adjacent to each other 
when an object image is split into a plurality of im- 
age portions on each image formation plane; 

an image synthesizing circuit for receiving 
information from said image pickup elements, 
and synthesizing the object image; and 



adjusting means for setting a photograph- 
ing condition by utilizing an output from one of 
said plurality of image pickup elements. 

5 8. A device according to claim 7, wherein said image 
pickup elements are controlled by a timing signal 
from a single clock generation circuit 

9. A device according to claim 7 or 8, wherein said 
10 adjusting means performs automatic exposure 

adjustment. 

10. A device according to any one of claims 7 to 9, 
wherein said adjusting means performs automat- 
is ic focus adjustment. 

11. A device according to any one of claims 7 to 10, 
wherein said adjusting means performs automat- 
ic white balance adjustment. 

1 2. Adevice according to claim 7, wherein said image 
pickup elements are controlled by a timing signal 
from a single clock generation circuit. 

13. An image pickup device comprising: 
split means for splitting image pickup light 

from an object into a plurality of beams in equal 
light amounts, and forming object images at dif- 
ferent positions; 

a plurality of image pickup element chips 
each having a plurality of light-receiving portions, 
which are split on a plane, the light-receiving por- 
tions being arranged at split positions which are 
not adjacent to each other when an object image 
is split into a plurality of image portions on each 
image formation plane; and 

an image synthesizing circuit for receiving 
information from said image pickup element 
chips, and synthesizing the object image, 

wherein a peripheral circuit portion of the 
corresponding image pickup element is formed 
between the split light-receiving portions of each 
of said image pickup element chips. 

14. A device according to claim 13, wherein driving 
circuits for driving said image pickup element 
chips are arranged in correspondence with the 
light-receiving portions, and are controlled by a 
timing signal from a single clock generation cir- 
cuit 

15. A device according to claim 13 or 14, wherein 
each of said image pickup element chip multi- 
plexes information from the light-receiving por- 

55 tions, and outputs the multiplexed information. 

16. An image pickup device comprising: 

split means for splitting an optical path of 



image pickup elements. 20 

4. A device according to claim 3, wherein said image 
pickup elements are controlled by a timing signal 
from a single clock generation circuit. 

25 

5. An image pickup device comprising: 

split means for splitting image pickup light 
from an object into a plurality of beams in equal 
light amounts, and forming object images at dif- 
ferent positions; 30 

a plurality of image pickup elements each 
having a plurality of light-receiving portions, 
which are split on a plane, the light-receiving por- 
tions being arranged at split positions which are 
not adjacent to each other when an object image 35 
is split into a plurality of image portions on each 
image formation plane; and 

an image synthesizing circuit for receiving 
information from said image pickup elements, 
and synthesizing the object image. 40 

6. Adevice according to claim 5, wherein said image 
pickup elements are controlled by a timing signal 
from a single clock generation circuit 

45 

7. An image pickup device comprising: 

split means for splitting image pickup light 
from an object into a plurality of beams in equal 
light amounts, and forming object images at dif- 
ferent positions; so 
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an object image obtained by an image pickup opt- 
ical system into a plurality of optical paths; 

a plurality of image pickup elements, ar- 
ranged at non-neighboring positions on corre- 
sponding image formation planes of the plurality 5 
of optical paths split by said split means, for pick- 
ing up corresponding image portions of the object 
image; 

synthesizing means for synthesizing the 
entire object image on the basis of information 10 
from said plurality of image pickup elements; and 

non-reflection members arranged on por- 
tions, where no image pickup elements are ar- 
ranged, of the image formation planes. 

15 

17. A device according to claim 16, wherein said im- 
age pickup elements are controlled by a timing 
signal from a single clock generation circuit. 

18. An image pickup device comprising: 20 

split means for splitting image pickup light 
from an object into a plurality of beams in equal 
light amounts, and forming object images at dif- 
ferent positions; 

a plurality of image pickup element chips 25 
each having a plurality of light-receiving portions, 
which are split on a plane, the light-receiving por- 
tions being arranged at split positions which are 
not adjacent to each other when an object image 
is split into a plurality of image portions on each 30 
image formation plane; and 

an image synthesizing circuit for receiving 
information from said image pickup element 
chips, and synthesizing the object image, 

wherein a wiring pattern to be connected 35 
to a connection portion arranged at a side edge 
of each of said image pickup element chips is 
formed between the split light-receiving portions 
of each of said image pickup element chips. 

40 

19. A device according to claim 18, wherein driving 
circuits for driving said image pickup element 
chips are arranged in correspondence with the 
light-receiving portions, and are controlled by a 
timing signal from a single clock generation cir- 45 
cuit. 

20. An image pickup device comprising: 

an image pickup element for photoelectri- 
cally converting image pickup light from an object so 
to output image signals in units of pixels; and 

an operation circuit for, when an output lev- 
el of the image signal is equal to or lower than a 
predetermined value, determining a signal ob- 
tained by adding and averaging image signals of 55 
neighboring pixels satisfying the same condition 
as image signals of these pixels. 



21. An image pickup device comprising: 

a plurality of image pickup elements for 
photoelectrical I y converting image pickup light 
from an object to output image signals of corre- 
sponding color components in units of pixels; and 

an operation circuit for, when an output lev- 
el of the image signal is equal to or lower than a 
predetermined value, determining a signal ob- 
tained by adding and averaging image signals of 
neighboring pixels satisfying the same condition 
as image signals of these pixels. 

22. A device according to claim 20 or 21 , wherein the 
number of neighboring pixels corresponding to 
image signals to be added is changed according 
to the output level of the image signal. 

23. A device according to any one of claims 20 or 21 , 
wherein a priority order is assigned to the neigh- 
boring pixels corresponding to image signals to 
be added according to spatial relative positions. 

24. A device according to claim 23, wherein a pixel 
having a smaller influence on resolving power 
has a higher priority. 

25. A method of converting a light image into an out- 
put image signal, comprising splitting an incom- 
ing beam into a plurality of beam components (L1 , 
L2), directing each of said components to a re- 
spective light detecting array (A, B) to produce a 
plurality of image signal components and combin- 
ing said image signal components to produce 
said output image signal. 

26. A method of converting a light image according to 
claim 25, wherein said beam components have 
substantially similar intensity. 

27. A method according to claim 25 or claim 26, 
wherein said light detecting arrays are mutually 
displaced within an image frame by less than a 
pixel spacing. 

28. A method according to any of claims 25 to 27, 
wherein said light detecting arrays are arrays of 
CCD elements. 

29. A method according to claim 28, wherein said ar- 
rays of CCD elements are standard television re- 
solution arrays. 

30. A method according to any of claims 25 to 29, 
wherein said light detecting arrays are controlled 
by a common timing circuit. 
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